When the GUI is open you should be able to use the default key ` to also close the GUI instead of clicking the close button or Esc. Just like opening and closing the vanilla inventory with the default key E