We made almost the exact same extension independently. Nice.
https://xiltsch.itch.io/pixel-puppet
Approximate procedure，Your level of completion is somewhat higher....
