I see what you mean. However, pulling the latches out into their own chip does seem to have fixed the problem.