Women are, in general, less shallow visually. If their man gains 10, 20 pounds, they don't care as much. But I've been with women over the years when my weight fluctuated, and they're definitely more interested physically when I am in really great shape.
My weight fluctuated when I was 30, and I did the unthinkable - I stepped out as a plus-sized model.