The special harm attaching to prior restraint is that the government can keep materials from reaching the public, so there can be no accountability, no judgment by the people that the power to suppress was wrongly exercised.
Our heads have a nasty habit of ruining what can make us happiest. And there are times in our lives when you have to put aside what we think is best and do with what you feel is best.