I am denying certain permissions of a plugin x that by default are allowed for everyone. The problem is that setting them to "false" affects all groups (even administrators).

I use the command /lp group permission set false.

Just set it to true for the groups that you want it to work for, make sure to set group weights properly as well.