I think you can still make him leave via isabella. But it's a good point, we might add an additional path to make josef leave for the endgame stage of the game.
