I like the game idea, I'd add more variety of items and stuff to do around the map, more treasures and traps, but I see a great potential on this mechanic!
Thank you, those are great suggestions!