Thank you for your answer.
Well I guess I should also question what my purpose in making games really should be.
Is it about the audience? If so, then I guess there are always different kinds of players. But that's both for adult and normal games I'd say.
Do I want to at least make a living out of it? Well, adult games or not, it's not that easy either way. I guess it's easier to start off with an adult game, but there is indeed this tradeoff you were talking about.
But if I focus more on myself, it won't really matter all that much. I mean, I'm also doing it for myself alright.
Also I can always just do both adult and normal games to see what works best for me.