Yeah, the second level can be a bit of a sticking point. The key is that you can rearrange multiple times while holding shift.
