Taking refuge means that you align and orient your life toward Buddha's example and toward enlightenment.
Affecting the world is obviously possible when we see people in the world who we really love and respect and we see how that they affect our lives.