The imbalance is flint dropping gravel.
In single-player there seems to be no config option to simulate the client side only mode for GravelMiner which in client side only mode you get 0 flint cause the gravel drops as a block due to the interaction of falling gravel on some non-full blocks.