Returning to where the character had been before does seem like the implied ruling, but I do kinda like the unstated flexibility!