Yup, that seems to happen exactly like you say when you move something to a room you haven't visited yet (the room isn't activated yet so the objects within it have no collisions). And then when you try to move one of the "joined" pieces, it might just jitter like you mentioned.