>I'm curious what you are referring to when you say "before switching between the two."
Very silly way to say that it would swap between super choppy and smooth every half second or so. To explain, I was using controller, and it happened the entire time I was playing. I played the game again, and the issue isn't there. I tried to recreate it by doing stuff with the window or mashing the controls, but nada. Sorry to say, but it seems like a freak Unity bug or somehow a windows bug(but I don't think my controller had any other issues that day).
Hope that didn't send you down a rabbit hole.