I wasn't able to reproduce it with just Immersive Portals in singleplayer, but a friend of mine was being chased by a skeleton on his server (dedicated) and he ran away through the portal, and was met with this crash shortly after.

Crash report:
https://pastebin.com/pe5wRyxZ

I added the check. It probably won't crash in the next version