You did not write what version of game you are playing, and on which platform.
Can you show screenshot when interacting is not possible? That might help finding why it does not work.
