Yeah, if you put an item into off-hand, it doesn't seem to remove the item when you place it on the altar... then you get an additional item back when you take it off?

Yeah, that seems to be a dupe glitch. It appears that the off-hand wasn't taken into account for the code responsible for placing and removing items from those blocks.