It's not just you, many people have commented on how hard it is. I've even made a video tutorial now and I'll add it to the next build when uploads are unlocked for the jam. I'm struggling to get to the 20 ratings needed for this jam and was hoping, if you wouldn't mind, if you could rate it on the jam page: