I'm opening this after my prior issue was closed for not being a Bug but an optifine issue which it isn't as I tried this without optifine and it still happened. anyways it happened after I opened my astral tome for the first time.

Nvm, I fixed it by removing astral sorcery then entering the world then re-adding it while having no optifine.