Yes I also found that level incredibly hard. I personally cheesed it by throwing the magnet onto the button in the back of the room and then running to the other side before the big block went up.
I also want to add that there are multiple dumb ways to be softlocked in this room like falling under the blue attractor when you don't have the magnet with you.