Is it normal that cars sometimes despawn in the middle of the road (not on the sides)?
No, this is not the intended behavior. But there's a known bug where cars randomly jump to a great height, presumably due to the quirks of Godot Physics. Your issue might be related to that.