I'm getting the pet selector on all worlds even though I only have the permission to get it at my hub world. I'm not OP'd and I don't think I've set it up wrong in config. I've tried using PerWorldPlugins to make it only work on the hub world but that's not working either, still using PWP for that though.

I had the same problem only with ranks. Each rank would be able to use every pet even though I just allowed them 7 certain ones, I fixed it by deleting each pet as ranks tier up so example
"- -echopet.pet.type.slime" of course this is I group manager, but maybe you could use that to take away the pet commands from all other worlds, so that they are there but not usable? I'm new to hub stuff multi worlds, sorry if this was a waste of time.
Use this is the world folders, for world configure maybe.
"- -echopet.pet.* "