Mostly the pop-up thing but also the fact that the close buttons are just for visuals. I think the way to make it more intuitive is to make the yes/no buttons grayed out when you are not standing on the pop-up.
thats a great idea, thanks for the feedback. i definitely plan to improve this game after the jam and will implement your thoughts!