Yeah the magnet power up pulls you towards the flag, even if you're below a wall at the moment, I'll try and change it so the magnetization stops if theres a wall between you and the flag. You can click the icon to turn the magnet relic off and it should just drop you to the floor.