I didn't really notice this problem in the later levels, maybe I just got better understanding the mechanic or the later levels do not suffer from this problem :P