No, you can't deny women their basic rights and pretend it's about your 'religious freedom'. If you don't like birth control, don't use it. Religious freedom doesn't mean you can force others to live by your own beliefs.
To enjoy freedom ... we have of course to control ourselves. We must not squander our powers, helplessly and ignorantly, squirting half the house in order to water a single rose.