To feel physically comfortable with someone else's body is not a decision you make. It has very little thing to do with how two people think or act or talk or even look. The mysterious magnet is either there, buried somewhere deep behind the sternum, or it is not.
One bad day could turn into a bad year if you're not careful. Or, a bad rest of your life if you're not careful. Because of one day!