Update, I did manage to figure out a fix for this, as it seems something within my world is automatically setting the render queue for the Supersampled UI, that the background of the buttons uses, to 4000 even after I changed it. I found a fix by just changing the material of the text itself to Supersampled UI Overlay instead and that seems to have fixed things.