Have you not had the living room scene yet? After that you can return to the strange structure then go to your room.
That should be it. The order is
Guild -> Structure -> Living room -> Back to Structure.
I tested it on a new 0.54 save and was able to do it. I'm not sure whether you are stuck because you are missing a step or if your save is bugged. The fact that neither part is green for Hidden Links makes me thing its an issue with your save.