6 ms·

Technically just advanced indexing of code snippets

vinnymac 4y ago
Precisely. I don't see a difference between what Google indexes on its search engine, and what CoPilot can recommend. Google has been and still does get slapped on the wrist when they don't respond to take down requests. It seems this is missing from CoPilot currently, and will open them up to a number of lawsuits in the future if it continues to operate as it does.
- merpnderp 4y ago
  Except Google isn’t creating anything new, Copilot is. I’ve had it kick out some very interesting short stories based on Sherlock Holmes, so if I published those would they infringe?
  - jhugo 4y ago
    You have no idea where they came from, or whether they are as new as you assume. Maybe they'd infringe, maybe they wouldn't!
    - merpnderp 4y ago
      Google returned nothing which contained exact matches of some of the more interesting dialogue. It would be a serious find - worthy of a paper - to disprove that GPT-3 is generating novel text/code.
      - jhugo 4y ago
        It's easy to prove that it sometimes regurgitates text verbatim — just play with it for a while. Having certainty that any given span of text/code is novel is extraordinarily difficult.
    - InvertedRhodium 4y ago
      Where does human creativity come from?
- nojs 4y ago
  > I don't see a difference between what Google indexes on its search engine, and what CoPilot can recommend. That is an extremely disingenuous take. It produces novel output, so is not merely an “index” in any sense of the word.
  - greyface- 4y ago
    Each search results page is novel and unique. Even two different users making the same query will get different results thanks to the "search personalization" Google is doing these days.
    - dahfizz 4y ago
      Google search doesn't synthesize anything. It collects results and orders them according to an algorithm. Copilot and similar language models can synthesize new text. That's clearly different than just presenting existing text.
      - belorn 4y ago
        Copilot can't create new novel concepts. In the end it is just an complex mathematical formula that return a set of code references with a set of length determined by the math. The illusion of creativity is similar to that of technology. Sufficient advanced technology is indistinguishable from magic, and sufficient advanced math is indistinguishable from intelligence. The relation between AI and math is the same as the relation between magic and technology.
UncleMeat 4y ago
All of the large language models can emit text that has never been seen in the training set (unless you go so far to consider each character to be a snippet).
- BeefWellington 4y ago
  They can also emit text that it verbatim copied. Infringement isn't about how the infringing system works, it's about the product of that work.
  - jhugo 4y ago
    > Infringement isn't about how the infringing system works, it's about the product of that work. Exactly this. It makes zero difference that you produced your infringing work with the help of a program that happens to be extremely complex and marketed as "AI".
- thesz 4y ago
  So do smaller models and I have to note smaller models are better at that.

Precisely. I don't see a difference between what Google indexes on its search engine, and what CoPilot can recommend. Google has been and still does get slapped on the wrist when they don't respond to take down requests. It seems this is missing from CoPilot currently, and will open them up to a number of lawsuits in the future if it continues to operate as it does.

merpnderp 4y ago
Except Google isn’t creating anything new, Copilot is. I’ve had it kick out some very interesting short stories based on Sherlock Holmes, so if I published those would they infringe?
- jhugo 4y ago
  You have no idea where they came from, or whether they are as new as you assume. Maybe they'd infringe, maybe they wouldn't!
  - merpnderp 4y ago
    Google returned nothing which contained exact matches of some of the more interesting dialogue. It would be a serious find - worthy of a paper - to disprove that GPT-3 is generating novel text/code.
    - jhugo 4y ago
      It's easy to prove that it sometimes regurgitates text verbatim — just play with it for a while. Having certainty that any given span of text/code is novel is extraordinarily difficult.
  - InvertedRhodium 4y ago
    Where does human creativity come from?
nojs 4y ago
> I don't see a difference between what Google indexes on its search engine, and what CoPilot can recommend. That is an extremely disingenuous take. It produces novel output, so is not merely an “index” in any sense of the word.
- greyface- 4y ago
  Each search results page is novel and unique. Even two different users making the same query will get different results thanks to the "search personalization" Google is doing these days.
  - dahfizz 4y ago
    Google search doesn't synthesize anything. It collects results and orders them according to an algorithm. Copilot and similar language models can synthesize new text. That's clearly different than just presenting existing text.
    - belorn 4y ago
      Copilot can't create new novel concepts. In the end it is just an complex mathematical formula that return a set of code references with a set of length determined by the math. The illusion of creativity is similar to that of technology. Sufficient advanced technology is indistinguishable from magic, and sufficient advanced math is indistinguishable from intelligence. The relation between AI and math is the same as the relation between magic and technology.

UncleMeat 4y ago

All of the large language models can emit text that has never been seen in the training set (unless you go so far to consider each character to be a snippet).

BeefWellington 4y ago
They can also emit text that it verbatim copied. Infringement isn't about how the infringing system works, it's about the product of that work.
- jhugo 4y ago
  > Infringement isn't about how the infringing system works, it's about the product of that work. Exactly this. It makes zero difference that you produced your infringing work with the help of a program that happens to be extremely complex and marketed as "AI".
thesz 4y ago
So do smaller models and I have to note smaller models are better at that.