I think this is probably a common problem jam hosts have but we don't have a solution right now. Weighted critieria would be an interesting idea, would you expect the other people to vote on it correctly or would you want to be the only one to be able to vote on it?
Why do you think kicking people out of the jam is hash? The rules should be displayed pretty upfront when submitting a game. Would you rather there be a way to disqualify an entry but still leave it as submitted?