Thank you for your comment and feedback! It seems that swiping too quickly causes problems with the collision detection - the control scheme definitely needs to be refined!
