In InteractWithDoor behavior, it uses

BrainUtils.computeMemoryIfAbsent(entity, 
  MemoryModuleType.DOORS_TO_CLOSE, 
  ObjectOpenHashSet::new
).add(new GlobalPos(level.dimension(), pos));

However, BrainUtils.computeMemoryIfAbsent fails to put the empty set into memory, as minecraft removes empty set from memory, causing the empty set not being added to memory. The fix would involve checking if the memory has a non-empty set, if so, add position into the set, and if not, add a new set containing the new position.