I have a server set up with several server side only mods, this being one of them. It seems that the combination of the mods, however, is leading to some very frustrating lack of functionality, for instance the Villagers Follow Emeralds mod does not work at all, and I suspect the Convenient Mob Griefing mod is not allowing farmers to interact with the world at all despite mob griefing being turned on. I don't know what end these are on though so I may send them some messages if you can get back to me.
Edited, this did not cause that issue and has been resolved. Griefing rules still seem to conflict though.

Going to update this with some of my findings
Villagers abide only by the vanilla mob griefing rule, not the lenient mob griefing rule, I think this may be on your end
Also, farmers seem to need to pathfind on top of composters before they are able to pathfind to crops, and they take forever pathfinding to crops for some reason but that might be vanilla. The being on top of the composter thing though definitely isn't, vanilla mechanics allow farmers to interact with their workstation from the block next to them and doesn't freeze their pathfinding on top of it