Yes! I actually released a patch to fix it. Characters that were created before the patch came out will still have diagonal gravity, but if you update to the newest version and create a new character, the problem will be gone. You can either download the newest version from the itch.io page, or use the itch.io app which will automatically update the game for you.