Wow, this is really weird. I had EXACTLY the same idea for a game which I made back for LD33. Though I didn't have time to finish the people-part in 2 days, but you can read the description http://ludumdare.com/compo/ludum-dare-33/?action=preview&uid=42012
Btw good job, really well done! :)