I find the player tracker appearing in your in-game view annoying, and could not find a way to disable it without also disabling the tracker in the minimap.

Am I missing a config option, or am I forced to see these trackers as soon as someone is ~20 blocks away?

This mod does not have that. It's a minimap feature.