In survival mode, when I hover my cursor in chest slot, the slot did not show. But it only shows when I'm in creative mode.

Please tell me if this is an actual bug or I'm doing something wrong.

Can you reproduce this in singleplayer with less mods? you seem to have several installed, some of which seem to change the survival inventory

You're using the Inventorio mod, which changes the survival inventory UI completely. There is a switch in the survival modded UI to disable it (you can configure that with a hotkey with Cloth). There, you can access Trinkets and other modded UI components that are not Inventorio.