Mouse sensitivity is a bit high. I'm assuming your supposed to bounce from one wall to the other, that's likely just not implemented yet. You can also easily cheese it by just walking around the bananas. I like the concept, keep working on it!
