So how does this all encompassing freedom of speech work? Am I allowed to come to your house and say whatever I want and you can not throw me out? Now you might

So how does this all encompassing freedom of speech work? Am I allowed to come to your house and say whatever I want and you can not throw me out? Now you might say your house is not a public space. So what about your garden? I guess I can come over and place any signs I like in your garden because it's my freedom of speech. That is the problem with these arguments if you actually think them through consequently it becomes completely impractical, because by forcing a "freedom from consequences" you violate every other right.