People who don't like you almost never come up to you. That's a lot of years of saying things that I know a lot of people in this country hate me for. And the number of times someone has come up to me and said something negative, I could count on one hand.
To use an electronics analogy, closing a book on a bookmark is like pressing the Stop button, whereas when you leave the book facedown, you've only pressed Pause.