Yes! All of the songs are just WAV files and, after installing the mod, they can be found in OFF/BepInEx/plugins/OFFRestored/Music. You can freely remove any songs you don’t want and they will use the Remake’s version.
If you’re planning on changing which songs are replaced after a playthrough, note that you’ll need to restart the program when you make changes; songs are not re-loaded during gameplay, only once on startup.