Have you heard of Mii Creator? Apparently the devs for that application are working on a project similar to this one. Maybe you could collaborate?
(Edited because the previous video I linked was made private.)
This is really cool, but unfortunately the controls made it very hard for me to enjoy it. If you could add left-handed keyboard controls (or better yet, custom keybindings) and a way to reduce mouse sensitivity, I would greatly appreciate it.