I know the set is supposed to confuse them, but this behaviour is a bit too much of a confusion. The piglins won't attack, but they will get aggro and de-aggro'ed rapidly when they see a player with Golden Piglin set, making a lot of noises and animations.