As the title says, the little hammer uses the left button to remove, but the left button also selects points in mark mode.

Oh damn, never though about that. Added the ability to use right click for hammer and paint brush to select the marked positions.