Shift+Right click with a wooden hoe (or whatever tool you have configured). Should toggle the fixed state, allowing you to destroy it like a normal item frame by punching it.