Why don't change "environment": "server", to "environment": "*", so it could work no client/server side, because in single-player CTM have the same issue as servers.
PssbleTrngle commented
Sure, did not realize this was also something happening in local world, but makes sense