Well, it doesn't. It doesn't help that I don't know the exact direction each are suppose to face. I've tried all of them facing toward the open tile, away, and each side as well, even inverting them so they face away (And then toward because that didn't work) from the tile of the statue opposite them.
Even using a teleport stone and going home, and coming all the way back didn't change anything.
Unfortunately I only keep 1 save so I can't go back before any of the puzzles without starting the game from scratch, since going back in time with saves is the only solution to this problem I've found anywhere.
Apparently if you do that puzzle last, as I have after not figuring it out the first time, is what causes this.