Yes you have to finish and upload your game to itch as normal first, once you've done that then return to the jam main page and press the big 'Submit your project' button at the top. That should give you a list of all your games, just select the one you want to enter. Don't forget you need to make the game public as well.