When adding ghost items using JEI, it's not possible to increase/decrease the items in the slot.

A suggestion on how to implement this could be using the mouse scroll wheel while hovering the ghost slot. This is an unused interaction as far as I remember, and is similar to how you move items using the Mouse Tweaks mod, which is common in many modpacks making it a familiar gesture for people to try.