When harvesting with right click (so that the crop stays planted), the farmer job does not get any XP for harvesting. It does get XP when left click destroying the crop.

Harvest the crop using a Farmers Hoe.
External 'Right click Farming' mods are not supported.