Are you using it for RPG Maker MV? When using it for RPG Maker MV you'll need to restart the engine without saving to see the changes. This isn't the case For RPG Maker MZ as the engine has a feature that prompts you to reload whenever outside changes are made.