This is neat, but with no way to confirm I've understood things correctly, it gets more and more confusing. I think it'd work fine as is in an interactive setting, but as a paper puzzle, there might need to be a few extra, subtle hints.
