From what I recall, there used to be a way to disable the icons in the world map, though I seem to be unable to find out where it is since the add-on's been updated for BfA?

There used to be an option to only track pets yet to be collected, but that filter seems to have disappeared (along with this same issue previously reported here by me and others since the update to BfA !)

Apparently the comments about this have been closed by the author - yet, as far as I am aware, no update has been done to the addon.