I might be missing the button, but I can't seem to find a way to exit the store purchasing UI once you've opened it. This means you can't complete either of the quests that require buying an item.
Hi! The button is there, but you pointed out something correct, it’s too small. I’ll improve it in a future update to make it more noticeable :D