Neat idea. Maybe start the player off in a smaller town, and work up to something bigger ?
I sometimes had the feeling the game was eating/ignoring my input. But things go so fast that it's hard to tell for sure.
