It still seems to generate the backup, and the error does not appear if the world dir is already present.
Note that this doesn't have anything to do with #20 or #21, and did not happen with 1.5.1.
Fadenfire commented
That's a bug, I'll release a new version fixing it soon.