Rye helped me in the comments -- it might fix it for you if you try either fullscreening the game window, or putting it into windowed mode, which for me fixed the menu buttons. Then choose "english" as the language from the menu, which fixes the in-game text.