There should be additional configurable settings around who you share quests with or receive quests from, such as:

• Blocking quest invites from certain users (ignore list)
• Only allow quests from friends
• Only allow quests from guild members