It can both be avoided and skipped.
With the Main Girls, you'll always be able to avoid and not have it happen entirely based on your decisions. With the Side Girls, most of the time, you'll also be able to avoid it, but some of the side-characters will only be skippable.