I believe it's possible for mobs to spawn outside of the rift area and cause the rift to fail.

Below are screenshots taken after the 1st and 2nd waves using tab to check for any mobs. I ended up failing maybe 5-10 seconds into the 3rd wave.

After 1st Wave

After 2nd Wave