Interesting. Don't forget, if you're forcing the user to interact with the voting, by changing the X-Y coordinates of their finger, then it's no longer a proper one button game.
However, it would work with iOS and Android switch scanning, so you're there in some ways. But if you want the nice web-browser version to work too, you may want to consider integrating scan-and-select. Where the options are manually scanned through (with a highlighter of some sort perhaps), and you select the one you want by tapping the screen anywhere (or pressing the SPACE BAR).