This is intended, only fish activate the minigame. Trash, treasure, and other inanimate objects do not. This is how it works in Stardew Valley, the game from which our mod is based on.

If you want trash and treasure to activate the minigame, you can make a datapack and add whichever items you want to the stardew_fishing:starts_minigame item tag.