I can see this mechanic working as a minigame or a quest. Even more, with additional features, polish and levels as its own thing. Great!