Are you looking at the menu before starting the game? Your difficulty doesn't actually get loaded from your save until you press "start game" which is something I'll fix in the fist update.
oh that makes sense