Just a quick update. After some early tests, it seems lag is a problem for people. While there's no real way for me to fix this without destroying the gameplay's flow in this game, it is something I'll keep in mind going forward developing for Twitch integrated games.