I've also experienced this - if you close and reopen the game it resets the slowdown, which isn't a perfect fix but definitely saves time overall