Very cool retro aesthetic! It gives of almost horror vibes.
I found that continually moving left or right while going up (ie, climbing the tower in a spiral) seems to confuse the boulder spawning in such a way that I never encounter any.
yeah the objects spawn randomly above the player so it might be why they missed you a lot, I'm glad you enjoyed it! :)