The broader concept of "free speech" is not a legal one, and so is a lot "mushier" and more nuanced. "There should be no negative consequences of any kind for anything anyone ever says" is obviously way too strong. I think "free speech" is more like: "there's value in hearing ideas that are new, different, or that we actively disagree with, and we shouldn't discourage people from expressing ideas like that".