Sometimes, part of the achievement screen can be seen outside of the GUI window, as shown here:

I have my GUI size set to large, but I noticed that scaling the achievements with my mousewheel also made this happen at normal size gui.

Resizing my Minecraft game window made it go away temporarily.