Took me a long time to debug this (way too long tbh)

But the ender inhibitor from mob grinding utils also prevents you from teleporting away from a nearby travel anchor, teleporting to it is not a problem.

Once I figured it out it was kinda obvious, but also kinda annoying.

Modpack is Stoneblock 3.

This is intended behaviour but I can add a config option to disable it.