Alright I'm just really dumb, My level loading system wasn't loading the scenes correctly and I didn't notice because I was testing it with them already loaded.
lol