1. Toss a bunch of items onto a runic altar (try 5 oak logs)
2. Sneak-right click a couple times.
3. Two items are sometimes removed from the altar.

Usually tends to happen more often when the items are the same, or when there's an odd number of items on the altar (but not always)