In theory, yes. It's best to narrow girls more and more towards the end, because the more you try to pursue everyone, the more points and events you will miss. As of ep3, there is no real big drawback for going for all of them, but that will change in future.