As far as I know, a hidden object doesn't catch touches.
So, when your object is invisible, it won't recognize the tapping action.
This eplains why it works the other way around.
I'd recommend using an interactive area (which is invisible, but recognizes touches) to use as your tap-area, and then show the other object with it.
Greetings,
Casimir