I'm gonna be honest, I don't see it this way. Maybe with girls he is a bit of a pussy, sure. But otherwise no...
The way the story's set up, the college is his ONLY chance for redemption. He had a shitty childhood, devoted his entire body and soul to volleyball, broke his shoulder so he couldn't play anymore, became angry at everything, pushed everyone away, and did crime. The offer from the Dean is literally his only shot to be even remotely close to volleyball again which is the only thing he's ever truly cared about. He wants to gather the team together because that's the only way he keeps his newfound job and if he beat the shit out of Fiona, she probably wouldn't join (Currently unknown just how important Fiona is to the team so maybe her absence wouldn't change much, except make Lexi quit too). Either that or the Dean would fire/expel/call the cops on his ass for beating up a student. All of which could easily result in him being homeless and on the streets again... Him acting like that is easily attributed to him not WANTING to be homeless. Because I'm pretty sure nobody ever wants that. Then there's also the fact that because he basically never gave anyone other than the mirror the time of day, it makes at least a little bit of sense that he wouldn't be good with women.
I feel like that punch from Fiona did more mental damage than physical. He already tried to get each member to show up, bungled it with Eve and Zoe, while Lexi just said that it'd be boring, and Fiona punching him was as clear of a "no" as you could possibly get. He was literally on his last legs there. Couldn't even bring himself to get riled up enough to attack her. And I already mentioned why attacking her would be a bad idea.
Now I already mentioned how the character "did crime," which I would say that it shows he isn't a pussy, but it's only mentioned in passing comments and his past isn't actually shown on screen. Maybe if more of it was shown onscreen it'd be better (idea for the dev there). Another thing is that the bad endings (usually for hitting/insulting women) COULD be more drawn out to better drive home just how badly the MC has it. Now there is also the option to slap Eve in the face, but it comes from the MC's anger towards her and just not understanding that she herself is someone with a weird personality. Which you know, he's trying to prevent and overcome that anger. So if your idea of a "strong man" is a man who gets so angry and gives in to that anger that he beats women... Then you should probably step back and rethink your definition.
In the end, it's an AVN and you should accept that even with a "pussy MC" it's still one of the better ones out there. The story's a classic example of an underdog story and the characters get better and more likeable the longer you play (cause you learn more about them and they undergo character development). If you want an AVN without a "pussy" as the MC, try out Nature of Magic (not an insult directed towards NoM, it's just also a good game and I'm genuinely recommending it to you.) Then there's Eternum where the MC gradually becomes better too.