Proposing an alternative to buttons for cave aesthetics: rocks! Similar to the Scenic mod, buttons could be replaced with small rocks of varying sizes that break after one hit. These wouldn't drop anything or get in the way too much, just acting as decorations in the caves.
The unique visuals combined with the reduced inventory clutter would greatly improve the cave delving experience with this mod.