5 ms·

> ChatGPT can read a 4,000 page bill in 3 days. Can it, though? The context window is nowhere near 4,000 pages. Getting ChatGPT to understand and summarize suc

> ChatGPT can read a 4,000 page bill in 3 days. Can it, though? The context window is nowhere near 4,000 pages. Getting ChatGPT to understand and summarize such a long document seems nontrivial.

shmel 3y ago
Add an intern in the loop that feeds every chapter separately and then compiles per-chapter summary that can then be summarized again if it is too long or has too many interdependencies.
orbital-decay 3y ago
It probably can, assuming that a bill can be separated into smaller parts, more or less independent of each other. Trusting the summary is another story. But expecting people to read 4000 pages in 3 days and make informed decisions after that is unrealistic, regardless of whether they are using lossy untrusted compression tools like ChatGPT.
- nathan_compton 3y ago
  "Trusting the summary is another story." What story could we possibly be interested in that involves having chat GPT read a bill but we don't care about a summary of it being accurate?
candiddevmike 3y ago
And with most bills I've read, the devil is 100% in the details. Of those 4000 pages, it might just be one sentence that has far reaching ramifications. Alternatively, folks will start maliciously crafting bills in a way that the ChatGPT summary misses the key parts.
- disqard 3y ago
  The new SEO will be LEO :) (AIO sounds less catchy)
  - CommitSyn 3y ago
    Maybe LLEO or LLMEO as LEO is already semi-widely known as Law Enforcement Officer.
- fennecfoxy 3y ago
  That's less of a GPT problem and more of a human problem: bills/contracts/T&Cs/ToS have all been massively blown out because: * Companies need to cover every minute detail/situation to prevent getting boned, especially in America where your citizens will sue at the drop of a hat * Companies want to purposefully bulk out the contract so that most people don't bother reading it
TrapLord_Rhodo 3y ago
super trivial actually. Just tokenize the document using Llama index and pass the vectorization instead.

> ChatGPT can read a 4,000 page bill in 3 days. Can it, though? The context window is nowhere near 4,000 pages. Getting ChatGPT to understand and summarize such a long document seems nontrivial.

shmel 3y ago

Add an intern in the loop that feeds every chapter separately and then compiles per-chapter summary that can then be summarized again if it is too long or has too many interdependencies.

orbital-decay 3y ago

It probably can, assuming that a bill can be separated into smaller parts, more or less independent of each other. Trusting the summary is another story. But expecting people to read 4000 pages in 3 days and make informed decisions after that is unrealistic, regardless of whether they are using lossy untrusted compression tools like ChatGPT.

nathan_compton 3y ago
"Trusting the summary is another story." What story could we possibly be interested in that involves having chat GPT read a bill but we don't care about a summary of it being accurate?

candiddevmike 3y ago

And with most bills I've read, the devil is 100% in the details. Of those 4000 pages, it might just be one sentence that has far reaching ramifications. Alternatively, folks will start maliciously crafting bills in a way that the ChatGPT summary misses the key parts.

disqard 3y ago
The new SEO will be LEO :) (AIO sounds less catchy)
- CommitSyn 3y ago
  Maybe LLEO or LLMEO as LEO is already semi-widely known as Law Enforcement Officer.
fennecfoxy 3y ago
That's less of a GPT problem and more of a human problem: bills/contracts/T&Cs/ToS have all been massively blown out because: * Companies need to cover every minute detail/situation to prevent getting boned, especially in America where your citizens will sue at the drop of a hat * Companies want to purposefully bulk out the contract so that most people don't bother reading it

TrapLord_Rhodo 3y ago

super trivial actually. Just tokenize the document using Llama index and pass the vectorization instead.