The reason so many people do not pray is because of its cost. The cost is not so much in the sweat of agonizing supplication as in the daily fidelity to the life of prayer.
You could just as well say that an agnostic is a deeply religious person with at least a rudimentary knowledge of human fallibility.