He does move at different speeds - its semi random to try and add to the feeling of not being in control at all but if it came across as frustrating then we may need to work on that a little!
The buttons / portal feedback is very valid. We were thinking of linking the buttons and portals with color (i.e. blue button turns on blue portal and exit is blue as well) the help with visual clarity, but a) one of our team is colorblind and we were aware that color may not be the best indicator but most importantly b) we ran out of time / energy / sleep... :-)
Thanks for playing and glad that you enjoyed it. This was our first ever Jam and I think we may have caught the bug...