The latter. Deleting uploads and adding others preserves the project's overall download counts, but not those of the individual files. Do it however you like, people will criticize you either way.
