Finally fixed mine. It turned out that one of the mods I had enabled was causing this issue. After disabling all mods, restarting the game, and loading a save, it was fixed.
I found the specific one by enabling them one at a time. I'll see if there is a newer version of the mod and if it fixed the issue. If not, I'll see about letting the mod's author know that bug.