Hi!
Your work is very similar to mine, Gesturio (also you can find wiki info and stand alone library)
Only finger angles is not enough for a good recognition, you also need palm normal, palm dirrection, angles between fingers. In my work, i used 23 degrees of freedom.
I hope you can find more better recognition method them mine. Good luck!