Or maybe only show it when in combat

No. Because you attack when the next tick is about to happen.

How about hiding it if all these apply:
Power bar is full
Out of combat
Not targeting a hostile

So it is always shown if you either don't have full power bar, if you are in combat or if you are targeting a hostile.