Players can log out in vanish and log back in with vanish disabled but aren't visible to other players around them.

I can confirm this, had to enable login vanished to force my users to unvanish so they are able to be seen. They are still seen with anyone who has vanish.see

Should be resolved with latest CB