I don't know if this is only the case with the 1.12.2 version of the mod, but Just Enough Items is required to be installed on the server for the mod to work. Is this intended?

I am asking this because I had to remove JEI from my server to fix a security issue, but now FindMe doesn't work anymore and I had to remove it from the server as well.

Yes, it is