It's bad enough when homophobes attack, but getting the same shit from our own people (I use the term loosely) is totally nuts. What possible difference does it make if your work is being enjoyed someone, regardless of gender (or lack thereof) and orientation?
IF some people are making shitty comments, ban them. If it's beyond your ability to do so, bring it up with the admins of whatever site it's on... We get enough shit in life from various haters without having creators of the things that keep SOME serotonin flowing (be it a VN, art or other creative outlet) getting harassed for not discriminating O_o