Really cool game, got me thinking a lot! As some others have said I think the dragging directly from the pile would smooth things out, but that doesn't detract from the core idea! Well done, good job!
Yeah now that I've rested a bit I can think of a few solutions to do that but... It wasn't a high priority given the crunch unfortunately!