I dreamed about this, so here's the ticket. Aside from BlockPos of the linked board, we should also track the world. I wonder if there's already a structure that encapsulates BlockPos and World? We need to change the NBT stored in the linking pearl to include (and then remove) that info as well.