Wait... what was the green key for? I solved the whole thing easily without it and didn't see anywhere obvious where it should go...
the green key opens the door to the house you start in- its just a shortcut so you don't have to use the tunnel every time you want to re-enter the house.