I've noticed that the Olive Branch block remains suspended in the air when the blocks around it are broken. If it has no support, it shouldn't stay floating like many other types of plants in Minecraft. I'm using the latest version of the mod, 2.2.5, for Fabric 1.20.1.

Can confirm on 2.2.5 for NeoForge as well.