Honestly, This is probably a VERY good move to add modding support as there is another adult game I know that has modding support and modders to this day are still very quick to push out alot of new mods out for that game which hopefully the effort here for this game will be better!
Hopefully this also gives you breathing room as while people are distracted by more custom ghost while you continue the work on the world building / story / maps at your pace so game at least will have alot of content going on from here user made and dev made and you won't have to work too hard on yourself with dealing with impatient people while there distracted :D
If anything it very much may be good to add those support later down the road from what you stated for the future as it should help lots for em!