Very interesting concept! If you just run with the core mechanic, develop more mechanics around it and polish the game, this could make a great rogue-like game. This project has a lot of potential, and I surely enjoyed playing it!
