I used two different controllers. One was an X-Box Pad, the other was an authentic Retroflag SNES pad. Both work the same. You've got to press them both simultaneously. Not Up and Jump, but Up+Jump at the same time. Once you get it, you'll start jumping out even when you don't want to.
