Yeah, you're screwed. You're gonna have to reload an old save file from when you still had the knight badge. If you overwrote all saves where you still had the knight badge, there's nothing that can be done about it and you'd have to either reload an old save file (making you lose a lot of progress) or just start a new game.