The Problem With Free Speech Absolutism

I don't see a significant difference between providing people with information that facilitates unjust behavior versus physically helping them. I'm not very optimistic that if we're concerned about hate speech, abuse of speech, ignorance, medical disinformation, that the solution is to let everyone say whatever they want all the time. That does not seem like it's actually helping to reduce the problem. Or what am I missing?