The grammar section works fine, though I have to teach that certain escape codes are okay and to leave them alone. But when I tell it to do something like create an item or skill...  It tells me it's done and gives me the breakdown in the app, but it doesn't add the item or anything to the actual game database.

Are you using it for RPG Maker MV? When using it for RPG Maker MV you'll need to restart the engine without saving to see the changes. This isn't the case For RPG Maker MZ as the engine has a feature that prompts you to reload whenever outside changes are made.  

Also, can you attach the screenshot of the assistant section with your prompt here.