Interesting idea! A little more in-game indication about where to go would be helpful, but I see the vision!
The short loop on the driving sound was 'driving' me insane, though! Maybe a fully looping sound that you fade in and out, instead of playing and stopping that sound would work better?