Yes, the progress bar would help. I think there may have been a bug/issue though where I was not interacting with the correct girl to break the wall, but I couldn't switch because of the debuff. I was leveling them up using one of the other icons, not the green plus. I think I ended up selling the girls to get out of the loop, or I reloaded. Not sure. x.x