Women and people of low birth are very hard to deal with. If you are friendly to them, they get out of hand, and if you keep your distance, they resent it.
Do not worry about not holding high position; worry rather about playing your proper role. Worry not that no one knows of you; seek to be worth knowing.