That may be the issue. I have done 15 Outerworld levels at x1 with not a problem. Hopefully that sorts the issue.
Another little glitch and I think I know what makes it happen. When you remove a character from your party, they are also removed from their Soul Room, if they are in one. I think. I will check this myself if you don't check it first.
