You don't need to mess with the floor layers, just change the CharacterBody's motion mode. The default mode is "Grounded" which is for platformers.
I see. I was following a 2d side scroller tutorial instead of a top down one and they never mentioned that lol. Well at least now I know for future games!
