3 ms·

I simply don't believe that this is fundamentally the work of an ai. Its in a different league to anything else I've read. It's structured, coherant and on topi

I simply don't believe that this is fundamentally the work of an ai. Its in a different league to anything else I've read. It's structured, coherant and on topic constantly. It would be really interesting to see the original text before human editing.

T-A 6y ago
The process is explained in the prologue (which I think would be a better link): https://thefirstaibook.com/ https://thefirstaibook.com/ I simply provided a few-sentence prompt on each of these subjects, had GPT-3 generate approximately 2,000 words of text each, and later (in most cases) removed the supplied prompt to keep the result as human-free as possible. It should be noted that, at times, I had to include ‘pivot’ phrases (e.g ‘therefore’, ‘in summary’, ‘perhaps’, and so on) before a new paragraph. Current networks appear to get off-track after ~1000 words, so this is necessary to improve consistency in predicting longer sequences of text. The final result was also copy-edited for spelling mistakes and punctuation (yes, AI makes mistakes!) Everything else that you will read – the logic, the reasoning, and the conclusions – was generated entirely by GPT-3.
- kd5bjo 6y ago
  > Everything else that you will read – the logic, the reasoning, and the conclusions – was generated entirely by GPT-3. The open question is how much did the human tweak the prompts in response to the generated text. Unless this was a moderately blind process, there’s a good chance that they kept rolling the dice until something they liked came out, which re-inserts a significant human element. I suspect that the human’s contributions likely rise to the level of co-author, or at least a very opinionated editor.
wimpypistol 6y ago
I was similarly surprised, but it's true. The original text is essentially the exact same (probably a 99.9% overlap) with the exception of a few spelling mistakes or grammar errors. My editing was about as much as you'd get from Microsoft Word, if that.
- jonnypotty 6y ago
  So you're telling me now the big challenge for AI is no longer making sense, it's spelling and grammar? I don't get it.
  - wimpypistol 6y ago
    This is a word predictor fed on billions of tokens of text. Because it has been trained on human writing, it makes characteristically human mistakes (including spelling, grammar, and even some phonetic errors).

T-A 6y ago

The process is explained in the prologue (which I think would be a better link): https://thefirstaibook.com/ https://thefirstaibook.com/ I simply provided a few-sentence prompt on each of these subjects, had GPT-3 generate approximately 2,000 words of text each, and later (in most cases) removed the supplied prompt to keep the result as human-free as possible. It should be noted that, at times, I had to include ‘pivot’ phrases (e.g ‘therefore’, ‘in summary’, ‘perhaps’, and so on) before a new paragraph. Current networks appear to get off-track after ~1000 words, so this is necessary to improve consistency in predicting longer sequences of text. The final result was also copy-edited for spelling mistakes and punctuation (yes, AI makes mistakes!) Everything else that you will read – the logic, the reasoning, and the conclusions – was generated entirely by GPT-3.

kd5bjo 6y ago
> Everything else that you will read – the logic, the reasoning, and the conclusions – was generated entirely by GPT-3. The open question is how much did the human tweak the prompts in response to the generated text. Unless this was a moderately blind process, there’s a good chance that they kept rolling the dice until something they liked came out, which re-inserts a significant human element. I suspect that the human’s contributions likely rise to the level of co-author, or at least a very opinionated editor.

wimpypistol 6y ago

I was similarly surprised, but it's true. The original text is essentially the exact same (probably a 99.9% overlap) with the exception of a few spelling mistakes or grammar errors. My editing was about as much as you'd get from Microsoft Word, if that.

jonnypotty 6y ago
So you're telling me now the big challenge for AI is no longer making sense, it's spelling and grammar? I don't get it.
- wimpypistol 6y ago
  This is a word predictor fed on billions of tokens of text. Because it has been trained on human writing, it makes characteristically human mistakes (including spelling, grammar, and even some phonetic errors).