Despite removing all related files such as configs and .jar - the mod persists even in previously unloaded chunks. Does it write to the world file in anyway? How can you remove it from a server?

If you deleted the jar from the mod folder, it won't affect any mobs anymore but already loaded mobs are affected.