Haha! That's a nice idea!
Unfortunately I have a non-standard keyborad layout (neo2) and can only type with all my fingers on the keyboard. Having one hand on the arrow keys I'm not able to press the right color keys.
Maybe adding a configurable WASD-movement can fix this? Then at least I could leave my fingers all where they belong on the keyboard. ;)