If you generate download keys in bulk using the download key groups feature then we can disable an entire group's access. This should work for the use case you're describing. In the future we'll likely add the ability for a developer to disable them all themselves, but for now you'll need to contact support about it.