It is important not to allow ourselves to be put off by the magnitude of others' suffering. The misery of millions is not a cause for pity. Rather it is a cause for compassion.
If we neglect or abandon those who are suffering in poverty ... not only are we depriving ourselves of potential opportunities for markets and economic growth, but ultimately that despair may turn to violence that turns on us.
As you say, I am honoured and famous and rich. But as I have to do all the hard work, and suffer an increasing multitude of fools gladly, it does not feel any better than being reviled, infamous and poor, as I used to be.