As others before me said - some indication when the controls are about to change would be beneficial. Also maybe ignore inputs when a button is hold between the levels or add a transition between the levels. Otherwise, I get into the new level while still holding the right button from the previous one and I immediately get flagged for a mistake.