27 ms·

Consider a mega consulting firm with millions of von Neumann-like analysts. Together, they've processed the same vast data that LLMs have, but individually, non

Consider a mega consulting firm with millions of von Neumann-like analysts. Together, they've processed the same vast data that LLMs have, but individually, none could. It's not an LLM, but its purpose is like ChatGPT: assisting clients with their tasks. If LLMs concern you due to their data processing, would a firm like this do the same?

bmitc 3y ago
Bringing up poor fitting analogies won't change my opinion.
- sebzim4500 3y ago
  I normally consider these discussion to be more about the people reading the comments than the people writing them. You've clearly made up your mind, but others presumably haven't so I think it's good he makes these arguments, even if it looks like tilting at windmills to you.
  - bmitc 3y ago
    That's a good point, but I guess I was implicitly getting at that continually permutating poor analogies and hypotheticals isn't an interesting discussion. The fact of the matter here is that parties, such as OpenAI, are benefiting from others' knowledge work, protected or not, in a completely one-sided way and all for free. And I don't feel sorry for companies that need to build Trojan horse products, such as OpenAI and Google, in order to survive off of other people's data that they never compensate for.
    - paulmd 3y ago
      Why should you get to profit in the workplace from the mental models you built in college from a commercially sourced textbook? Doesn’t Pearson actually own the knowledge you’re using on the job at $BIGCORP? Why do you get to profit off diffusion based on their work? Someone else made the analogy - if you read a NYT article and then go do a stock trade based on what you read, didn’t you do that based on value generated by them, and why wouldn’t they own that too? Like if you don’t want to talk analogies then talk principles, and humans are diffusion machines. When you write a term paper from sources you are simply diffusing those words into a new arrangement, but it’s still fundamentally someone else’s work. Why do you get to profit off the model that results from someone else’s work? Copyright has mutated into this bizarre chimaera where people (like NYT) are essentially claiming ownership of ideas (and derivative works fall into a similar space) and that’s inherently in conflict with a system that is supposed to promote the creation of works. But it has turned into this bizarre shibboleth that if you came up with an idea it’s yours for life+75 years, completely yours and nobody else can work off it or remix it without crediting you. And that’s an unusual state, humanity hasn’t existed like this forever, the Berne convention is only 50 years old and already falling apart from unintended consequences. Anyway there’s no proof that copyright benefits the small guy more than corporations. Disney squashing someone for writing a Star Wars fan fiction happens a lot more than Disney ripping off someone’s fanfic character for their series. Like patents there’s this mythos of it benefiting the small guy and that’s absolutely not how it works in the real world. Also, NYT is a particularly egregious plaintiff here because they’re essentially just factual reporting of occurrences, which (like a phone book) are not really copyrightable in itself. You can copy a phone book without infringing copyright and you can train an AI model on a phonebook, and training an AI model on NYT in particular is basically doing that but for historical facts and occurrences. The fact that this costs money for NYT to generate is irrelevant, this is the “sweat of the brow” doctrine and was already swept aside by the phone book case. Just because you spent time/money making it doesn’t mean it’s copyrightable. A large amount of NYT comment is factual observation and tabulation and probably is not copyrightable in the first place. But separating that out is of course going to be challenging for NYT’s lawyers!

bmitc 3y ago

Bringing up poor fitting analogies won't change my opinion.

sebzim4500 3y ago
I normally consider these discussion to be more about the people reading the comments than the people writing them. You've clearly made up your mind, but others presumably haven't so I think it's good he makes these arguments, even if it looks like tilting at windmills to you.
- bmitc 3y ago
  That's a good point, but I guess I was implicitly getting at that continually permutating poor analogies and hypotheticals isn't an interesting discussion. The fact of the matter here is that parties, such as OpenAI, are benefiting from others' knowledge work, protected or not, in a completely one-sided way and all for free. And I don't feel sorry for companies that need to build Trojan horse products, such as OpenAI and Google, in order to survive off of other people's data that they never compensate for.
  - paulmd 3y ago
    Why should you get to profit in the workplace from the mental models you built in college from a commercially sourced textbook? Doesn’t Pearson actually own the knowledge you’re using on the job at $BIGCORP? Why do you get to profit off diffusion based on their work? Someone else made the analogy - if you read a NYT article and then go do a stock trade based on what you read, didn’t you do that based on value generated by them, and why wouldn’t they own that too? Like if you don’t want to talk analogies then talk principles, and humans are diffusion machines. When you write a term paper from sources you are simply diffusing those words into a new arrangement, but it’s still fundamentally someone else’s work. Why do you get to profit off the model that results from someone else’s work? Copyright has mutated into this bizarre chimaera where people (like NYT) are essentially claiming ownership of ideas (and derivative works fall into a similar space) and that’s inherently in conflict with a system that is supposed to promote the creation of works. But it has turned into this bizarre shibboleth that if you came up with an idea it’s yours for life+75 years, completely yours and nobody else can work off it or remix it without crediting you. And that’s an unusual state, humanity hasn’t existed like this forever, the Berne convention is only 50 years old and already falling apart from unintended consequences. Anyway there’s no proof that copyright benefits the small guy more than corporations. Disney squashing someone for writing a Star Wars fan fiction happens a lot more than Disney ripping off someone’s fanfic character for their series. Like patents there’s this mythos of it benefiting the small guy and that’s absolutely not how it works in the real world. Also, NYT is a particularly egregious plaintiff here because they’re essentially just factual reporting of occurrences, which (like a phone book) are not really copyrightable in itself. You can copy a phone book without infringing copyright and you can train an AI model on a phonebook, and training an AI model on NYT in particular is basically doing that but for historical facts and occurrences. The fact that this costs money for NYT to generate is irrelevant, this is the “sweat of the brow” doctrine and was already swept aside by the phone book case. Just because you spent time/money making it doesn’t mean it’s copyrightable. A large amount of NYT comment is factual observation and tabulation and probably is not copyrightable in the first place. But separating that out is of course going to be challenging for NYT’s lawyers!