It should be a player choice, as it is in vanilla. Villagers don't run away from players unless they are attacked and golems won't attack until the mentioned happens. So, why can't it be the same for player latex?
On the other hand, now that I think of it, an extra condition that would increase the player's (non-latex and latex) reputation could be defending a villager from attacking entity latex.

i'd imagine that as a gamerule

i'd imagine that as a gamerule

Could be, I'm not too sure about this approach however.
If it did happen, it should be off (villagers not scared of players) by default.

Also wandering trades are literally impossible to trade, they won't stand still even if you right click on them...

Maybe this could be a toggleable feature for 13.1? Or 14.0?

Just make a Check to See if the player get the Hero of the Village effect and if it does a variable Will be set true and the player will no longer scare Villagers and get target by Iron golens