When I first start this plugin, everything works fine, but after I disconnect and reconnect, the plugin doesn't do anything and also after restarting the game.

Please provide CustomSkinLoader.log and fml-client-latest.log.

You can reopen this issue after providing log file.