Not allowed to do anything, this game always puts me in a fight no matter where I am and most of them aren't even skill based and just purely luck. Never been this frustrated as I'm literally not allowed to progress no matter what I do
You can use the skip combat button if it's not your thing.