Riches and honor are what everyone desires, but if they can be gained only by doing evil, they must not be held. Don't worry about not being in office, worry about qualifying yourself for office. Don't worry that no one knows you, but seek to be worthy of being known.
The worries that are the burden of which the privileged person makes an excuse in dealing with the oppressed person are in fact the worries about preserving his privileged condition.
I've learned one important lesson in my life, and I'm going to share it with you. Don't worry about bad things that haven't happened yet. It will save you a lot of anxiety.
My particular worries on any given day - how I'm doing in the polls or what somebody is saying about me... for good or for ill - isn't particularly relevant. What is relevant is: What am I building that lasts?