How can I make it so when I join I'm not vanished.

If you join vanished, you've granted yourself those nodes. Fix your permissions setup.

I have my admin with the permission * does this mean I will have to add all my plugins nodes to admin for this to work?

Negate vanish.* and then re-add the vanish nodes you want.