Hi, thanks for trying out our game!
The Wit die you've used during a race won't passively recover until the race is over; which also means they won't recover at the start of your speed phase either. The only way to recover Wit die in the middle of a race is using skills such as "Resourceful" or "Reliable currents" for example.
Hope this helps!