Now that we're sorting by lastDetectionTime an issue has become apparent. Since we're refreshing the data--including lastDetectionTime--on every combat log event, when detected players are fighting around you, their portraits start to rapidly switch place as the events keep being fired.

A more semantic approach is to sort data by last encounter time, which value should be refresh after the data becomes stale, i.e. it's a new encounter with that player.