My personal belief is we should not bow to any object. But Islam was aware of this human weakness and fulfilled that need through Haj to kiss a stone. A stone is a stone but the vacuum was filled and it became the holiest object. I have performed Haj and seen the devotion of people braving stampedes only to kiss that stone.
If you're frightened of damaging yourself, you increase the risk of doing just that. Consider the tightrope walker. Do you think he spares any thought for falling while he's walking the rope? No, he accepts the risk, and enjoys the thrill of braving the danger. If you spend your whole life being careful not to break anything, you'll get terribly bored, you know. . . I can't think of anything more fun than being impulsive.