Criminals, people who commit crimes, usually society rejects these people. They are also part of our society. Give them some form of punishment to say they were wrong, but show them they are part of society and can change. Show them compassion.
It took the Church until 1832 to remove Galileo 's work from its list of books which Catholics were forbidden to read at the risk of dire punishment of their immortal souls.
My position concerning God is that of an agnostic. I am convinced that a vivid consciousness of the primary importance of moral principles for the betterment and ennoblement of life does not need the idea of a law-giver, especially a law-giver who works on the basis of reward and punishment.
Exemplary people concern themselves with virtue,
small people concern themselves with territory. The ruling class
thinks of punishment, the lower classes hope for benevolence.
To kill someone for committing murder is a punishment incomparably worse than the crime itself. Murder by legal sentence is immeasurably more terrible than murder by brigands.
Release old concepts and energies that keep you in self-punishment patterns. Release old stories and create from a place of love and self-validation. You are worth it!
Capital punishment kills immediately, whereas lifetime imprisonment does so slowly. Which executioner is more humane? The one who kills you in a few minutes, or the one who wrests your life from you in the course of many years?
Temporal punishments are suffered by some in this life only, by some after death, by some both here and hereafter, but all of them before that last and strictest judgment. But not all who suffer temporal punishments after death will come to eternal punishments, which are to follow after that judgment.
But secondly you say 'society must exact vengeance, and society must punish'. Wrong on both counts. Vengeance comes from the individual and punishment from God.