As requested in this forum topic, tell your challenges to just scram!
The easiest way to use the addon is to make a macro by typing /macros, click New, give it a name and an icon and enter /scram as the contents.
Drag it to your actionbar and now whenever you get an unwanted challenge you can simply press the keybinding for that button to cancel the currently active challenges.