We run a lightly modded server, and we always have items being thrown on the ground when we go to take things out of them. Only inventory mods are Inventory Profiles Next.
We are on Fabric, newest mod version as well.

I also have this issue. After a while, it begins to get annoying because sometimes it will work normally and other times, clicking an item will just throw it.