By clicking on the option to turn it on it showed horde faction icon.
Did nothing more than turning it on.
Now I switched to alliance side (and realm), and it is not showing for alliance nor horde.

Unfortunately I can't reproduce this. Faction Icon for e.g. Stormwind Guard is displayed correctly on my side.