Life is full of grief, to exactly the degree we allow ourselves to love other people.
As someone fairly committed to the death of our solar system and ultimately the entropy of the universe, I think the question of what we should worry about is irrelevant in the end.