That's absolutely correct and in addition to that life just isn't an accident of the laws of physics. There's a long list of experiments that suggest just the opposite.
Alan Watts, the Buddhist scholar, proposed the existence of a mental faculty he called forgettory, which is the flip side of memory. There are times, Watts maintained, when we need to forget things, to let them slip away into the unremembered past.