After the second time playing, I realized that I can keep haunting, and moving back and fourth without the shaman having the chance to enter the house aha.
Yeah, the back and forth technique makes it reaaally easy :D
