Nevermind, I watched a speedrun and figured it out. I guess I had the wrong key. They all look the same tho.
The key needed to activate the rocket has since been recolored green, as has the door to the rocket's switch.
