5 ms·
Here is the output of GPT reading and summarizing this (see https://news.ycombinator.com/item?id=33748363 https://news.ycombinator.com/item?id=33748363). Model
by wskish 4y ago
Here is the output of GPT reading and summarizing this (see https://news.ycombinator.com/item?id=33748363 https://news.ycombinator.com/item?id=33748363). Model seems to be hallucinating the author. Any thoughts on how to improve it?
"The Need to Read is an essay written by Kevin Kelly. In it, he argues that reading is essential not just for acquiring knowledge, but for learning how to write. He cites the example of a science fiction book in which reading has been replaced by a more efficient method of knowledge transfer. He argues that even if such a method existed, it would be insufficient because it would not allow for the kind of discovery that writing does. He concludes that people who want to have ideas can't afford not to read."
- TekMol 4y agoDoes GPT-3 offer summaries out of the box? Or do you do it by a prompt like "The summary of the text above is:"?
- wskish 4y agowe are strategically prompting it as such: https://news.ycombinator.com/item?id=33750013 https://news.ycombinator.com/item?id=33750013 open to all ideas here
- TekMol 4y agoIs a "prompt prefix" a thing in GPT-3 or do you mean you combine that prefix with the text of the page into a prompt?
- wskish 4y agoWe prepend the prompt prefix to the page text to create the actual model prompt. GPT doesn't have any such abstraction.
- TekMol 4y agoAnd GPT-3 remembers the prefix at the end of a long story and writes a summary? That sounds very surprising to me. I would have strongly expected it continues the story.
- zktrust 4y agoi think that's also rubbish, just like PG's written opinion piece. How on earth did we then get the great work by William Shakespeare. ShakeSPeare born a time when reading a lot wasn't even possible. There was little to none good content material out there. He was writing more than he could have possible read anywhere else.
- mikebenfield 4y agoSo you are under the belief that the written output of one man born in 1564 was of greater quantity than all “good” writing prior to his time? Are you sure you thought this through?
- zktrust 4y agono i am not under the belief of anything other than mentioning PG in a slightly bad light will get me downvotes or a ban on this platform. > So you are under the belief that the written output of one man born in 1564 was of greater quantity than all “good” writing prior to his time? Are you sure you thought this through? This is not the point i was trying to make.
- mikebenfield 4y agoI am not a huge fan of PG and I seriously doubt that had anything to do with your downvotes.
- inglor_cz 4y agoIt is not PG, it is your sneering and arrogant attitude that attracts downvotes. I haven't downvoted you, but if I did, it would be for the tone of your comments alone. I don't care about PG one way or another, but I am sick of the total level of glibness on the Internet, and while I gave up on mainstream social media, I would prefer HN to stay a little bit friendlier and less toxic than Twitter or Reddit.
- zktrust 4y ago
- wskish 4y agoI tweaked the GPT prompt to include the domain name from the story url as additional context. That fixes this one and a few other problematic ones. Here is a typical summary of this story now: "This is an essay written by Paul Graham in November of 2022. In it, he talks about how reading is necessary not just for acquiring knowledge, but for learning to write well. He argues that there is no substitute for reading, and that people who want to have ideas need to be good at reading."