you said it yourself, it doesn't necessarily mean there's something wrong with ttrpgs. But there could be. Do you have to look for it? I don't think so, but I think it's probably worthwhile to do the investigating.
Fascism (for example) doesn't exist in isolation. The idea didn't spring fully formed from nothing. While it's fallacious to say that anything overlapping with it is automatically tainted, it's also fallacious to say that it automatically isn't.