Thanks for making this game!
This give me an inspiration to convert my first game (3D) in 2D using Matterjs to make it Instant Play.
As long as you can update your element position with a proper loop, anything should work with matter js. The documentation is well done, so you wouldn't have an issue with binding svg elements. That being said, it all boils down to the code you write. I can assure you that the physics engine works very well.