4 ms·
> In post-task interviews: > 83.3% of LLM users were unable to quote even one sentence from the essay they had just written. > In contrast, 88.9
by jennyholzer 1y ago
> In post-task interviews:
> 83.3% of LLM users were unable to quote even one sentence from the essay they had just written.
> In contrast, 88.9% of Search and Brain-only users could quote accurately.
> 0% of LLM users could produce a correct quote, while most Brain-only and Search users could.
Reminds me of my coworkers who have literally no idea what Chat GPT put into their PR from last week.
- aurareturn 1y agoMaybe we should question the value of essays in the ChatGPT world? Could a person, armed with ChatGPT, come up with a better solution in a real world problem than without ChatGPT? Maybe that's what actually matters.
- kibwen 1y agoThe point of writing essays is not to produce an essay, it's to demonstrate that you understand something well enough to engage with it critically, in addition to being an exercise for critical thinking itself.
- Ekaros 1y agoCan they evaluate if the idea that came up with is better if they do not remember how it was stated? Isn't point of writing actually to formulate down the thoughts in communicable manner. And then possibly to be verified by others. But how can they discuss any content if even the "writer" does not remember what they wrote.
- abirch 1y agoCollege was transformed from an apprentice style institution of the 1500s to mass produced thing of the early 2000s (where a professor can "teach" 500 students in a class). I think a return to the apprentice style of institution where people try to create the best real world solution as possible with LLMs, 3D printers, etc. Then use recorded college courses like our grandparents used books.