Will I end up needing to delete the 23.5.0b version and restarting when this fix comes out or will I be able to just throw the new one on top of the one we already have and continue like nothing happened?
Your saves will be compatible.
If you didn't alter the game files, "throw the new one on top of the one" should work.
