Tried to use one to travel to and from my nether base (from the overworld) but it didn't function. It did when I placed the destination in the overworld. Is it supposed to work between dimensions?

No, it's only supposed to work in the same dimension.

A later update will likely add another tier of teleporter that can do that.