The Crown of Chaos should not give a luck effect, but a luck attribute so that you can, for example, drink a luck potion, or otherwise get a luck effect and it's luck will add up.

That's a fair point, would require a lot of changes when it comes to how Withered Wabbajack handles dice rolls with luck though, but I suppose that code needs a rework either way.