Or maybe make it so that accounts under certain reputations couldn't downvote more than once a day (or at all).