Players get hit by projectiles, causing the particles to give off the players location. A possible fix could be cancelling the projectile hit event for vanished players or deleting the entity (both may still show their location but it may make it less noticeable)

This should be resolved as of the recent releases, when running Paper (or forks of Paper)