You're only able to cross the river while the dam is closed. It only stays closed for 2 minutes after the timer ends. So if you get there more than 2 minutes late, you won't be able to cross.