I'm using Godot 4 and I tested with this other font and the issue wasn't happening at the default font size.
Ok great! I just published it here in case that helps: https://sparkyondo.itch.io/catch-the-greeble.
Hi again! Sorry to keep you waiting, but I think I have the fix :)
In the default import settings for .ttf format fonts in Godot 4 antialiasing is turned on - for pixel fonts like mine, you'll want to disable this to ensure it renders correctly.
To do this, double click on the font file from inside the Godot editor, which should bring up a dialogue box:
From here, you'll want to set antialiasing to "none", which should fix the majority of artifacts you see.
You may also want to disable hinting, or adjust subpixel positioning - these will likely have a subtler effect, depending on your project settings.
Make sure to reimport the font using the button at the bottom of the dialogue box before closing it to ensure your changes are saved.
Hopefully this helps, but let me know if there's any further issues! :)