When you level up with McMMO with this plugin enabled it kicks the player with an error like this:

The server was not reloaded, and was only restarted. There is nothing in the console when this happens

It's a bug that seems to happen randomly with no clear reproducible steps. https://hub.spigotmc.org/jira/browse/SPIGOT-6056
Temporary fix is to just restart the server.