I noticed that even while the Spectre Dimension is empty, it is still loaded into memory even when it's unoccupied. There's no way to disable this feature either to help save on performance.