With your mod installed, my server has the problem below, I don't know what changed, but when I used it on 1.19.2 this didn't happen.
The problem only seems to appear with more than one player online.

Mod list: https://pastebin.com/NEwdQt55
Server latest log: https://pastebin.com/MU21BqQg

I'm just gonna guess this is #638 related, please try that if the issue persists,
narrow down exactly which mods cause it please.

The issue persist

narrow down exactly which mods cause it please.

it's not feasable for me to look for a performance issue amongst 200 potential conflicts, that may be world dependant