I really like the style and overall concept but I had a lot of trouble with the movement and overall controls (may have been my emulator setup?). I think the OoT idea you discussed below would be really helpful.
Really cool that it's compiled as an actual N64 game though!