I've tried everything I can think of. I thought maybe it was an Adventurer's Backpack interaction issue, but I turned off all it's collecting things.

Nevermind, I'm an idiot. Someone else with a magnet backpack was close enough.