I get there being different downloads for Windows, Mac, and Linux but what's the difference between the one called default and the other items with numbers on the end?

The numbers are the weekly releases. Default is always whatever the latest is. (The highest # is also the latest)

We're still in development so saves aren't always backwards compatible, so we make the old builds available as a convenience.