No you definitely don’t need to restart XD Make sure you have done all the interactions with the girls too like their trainings or chat with them since some scenes are from there. Also there might be a shower scene you are missing with them too
