Yep. This was a problem I encountered during playtesting and I didn't really know how to fix it, especially with the limited time I had to make the game. Will keep in mind for the update though! :)