The ground for taking ignorance to be restrictive of freedom is that it causes people to make choices which they would not have made if they had seen what the realization of their choices involved.
The only possible basis for a sound morality is mutual tolerance and respect: tolerance of one another’s customs and opinions; respect for one another’s rights and feelings; awareness of one another’s needs.