I really like the idea but there's something missing.
My first instinct was to match the appearing gestures - even though I know how to play Rock, Paper, Scissors.
Also it's kind of weird that matching the gesture subtracts a life, shouldn't it be that matching with Rock against Paper would subtract a life?