I don't think you're understanding my point. These people believe that the existence of closed source software is a violation of their rights, so they too would

I don't think you're understanding my point. These people believe that the existence of closed source software is a violation of their rights, so they too would make the argument that your freedom ends where my freedom begins.