I would suggest to fix that asap
It already crashed my server once due to time out (maximum 60sec in default)

In twightforest is worst for me
Overworld happened also but not so bad
It can also cause HUGE TPS drop
Drop to like <5TPS to time out killed by watchdog
I wish this can be fixed asap

Here is crash reports and log
https://discord.com/channels/1087749025488449667/1106671615888081016/1237060699402797158

Bellow is profiled after server crashed then restarted

Here is dim:0 when flying to load new chunk
https://spark.lucko.me/TloRa7alK1

Here is dim:6 (twight forest)
https://spark.lucko.me/mm6w4fSkGq

I have same issue