I get a lot of people coming up to me and saying, "I really hate you. " And they say it in the nicest possible way and I accept it. It's the people who come up to you and say, "I really liked your character. Man, he was right!" Those are the ones you worry about.
I don't expect people to agree with all my votes.