when I toggle all the vanish effects off when you restart the server they all turn back on.
Is this a bug/ is there any way to keep them off permanently?

They're off by default. If you're getting them when you join, then you granted the perm nodes on yourself for them. Don't, uh, do that.