All human beings share certain universal human rights. But I am not just a human. I am also an American, a Kansan, a university instructor, and a member of a church body. Each one of these relationships generates specific goods, rights, and responsibilities that are unique to me. The same is true for nation-states, each of which have a distinct culture and unique responsibilities to its own citizens.
Freedom isn’t just the bare ability to do something; it is the ability to act under the influence of properly functioning cognitive faculties. If you value freedom, then you should oppose the legalization of recreational drugs.
Consent only has value when it is used to make decisions based on knowledge of what is truly good for us as human beings.