Pretty weird! Have you tried the new version (1.3)? It fixes controller issues.
Yes, I am using v1.3. It seems to be a problem with all the Dinput controllers I have. Shoots up without pushing up. I tried recently the Genesis Mini controller, also same issue. You don't see a problem with Dinput controllers? Xinput controllers seem to work fine.