You can add friends with the Gather spell, but can u remove them?

That'll be in the next version. It may or may not currently be in the latest dev build, implemented but not tested.

You can now aim down and cast to remove friends, but I have also disabled gather since it's really been a pain to support. If you want to keep it, do /mconfig enable spell gather.