Resolved! Disabling full screen in the settings (Which are confusingly not located in the Celeste folder...) fixes the tearing, despite not making it a windowed window!