It hurts to hear that you arn't feeling well, you should work on whatever bring you joy. Personally I wouldn't remove masuo or ringman elements from the other games, I like ringman the most, but I played HTA and LST because of ringman. The connections to ringman are a fundamental part of those games and they have been from the start.
It would create more work to remove them but also I feel like it would hurt you a lot to have to cut them out. You have been working on ringman for a long time and if it makes you feel good to create it fully then keep going. In my opinion the more you show of ringmans story, the more people can appreciate the connections in the other games. I love the interconnected nature of the games and you should keep them. Dont let haters change your grand plan, trust yourself first and foremost.