You can! If you count the colored squares along your path between the two towns, that's the number of days it'll take. Fatigue happens on the black squares.