This is only when used in combination with Optifine.

Any way to fix it? Optifine seems to be incompatible.

Optifine is not compatible. You should use Rubidium for performance and Oculus for Shaders as alternatives.