The gravity does get weaker the further out you go, but you are right, it is rather sudden.
Technical mumbo jumbo: We wanted to use the Godot Curve type, but couldn't get it working. So we used a linear equation, but it turns out the math doesn't math the way we expected so it's not actually a linear equation lol. By the time we figured that out it was too late to change how gravity was calculated cuz we'd have to edit the curve to make it feel good, but it felt good to us as it was. So we scrapped the curve for our (my) faulty math.