4 ms·
The entire process whereby laws are drafted and enforced is alarming. Lobbyists and people who disagree with your way of life have substantial influence. I beli
by roenxi 4y ago
The entire process whereby laws are drafted and enforced is alarming. Lobbyists and people who disagree with your way of life have substantial influence. I believe that for some of the largest expenditures of my lifetime the US Congress voted literally without people having read the final text bills they were voting on [0]. The language is interpreted by a large group of unreliable judges and juries. Corruption hangs in the air, and people who talk rationally are thin in the conversation. Lord of the Flies looms large in everyone's minds.
Using AI in the drafting process is hardly something to get worked up about in amongst that mess. ChatGPT has a nice clear style and will probably help make these laws more accessible.
ChatGPT can read a 4,000 page bill in 3 days. It'll probably be a net win once the dust settles if it makes it harder to ram stuff through without debate. And it'll be a nice neutral way of arguing about what is in a bill - people might be able to agree on which AI is reasonable and what it thinks the summary should be. That'd be a win the size of the moon in terms of better pressure to write good legislation.
[0] https://www.bbc.com/news/world-us-canada-64069764 https://www.bbc.com/news/world-us-canada-64069764
- throwawayadvsec 4y ago"ChatGPT can read a 4,000 page bill in 3 days."? in 3 minutes?
- cardboardbach 4y agoOf course, but the statement was likely a jab at an organic congressperson's inability to read a bill in even three days, before going ahead and signing it anyway.
- saulpw 4y agoActually it takes about 10-30 seconds (one request) for GPT4 to summarize 2000 words (a page or two). And there is a limit of 25 requests every 3 hours for GPT4, and no API access. So this might even take significantly longer than 3 days.
- dmreedy 4y agoI agree with the first part of your comment. I'm not sure I can follow you where you take it though. > ChatGPT has a nice clear style and will probably help make these laws more accessible. If the laws are not meant to be read in the first place (which I agree with as a likely pattern), how is this motivating? I'm skeptical that they're not read because of their density. I'd flip the causality; they're dense because they're not to be read. > nice neutral way of arguing about what is in a bill Elon Musk is already talking about "TruthGPT", an AI without "liberal bias". I don't think you will find anything resembling neutrality in this conversation.
- roenxi 4y ago> Elon Musk is already talking about "TruthGPT", an AI without "liberal bias". I don't think you will find anything resembling neutrality in this conversation. Between TruthGPT, Chuck Schumer & Mitch McConnell I would expect the most honest summary to be TruthGPT. I doubt it'd be close. Even with a very healthy dose of cynicism towards all billionaire projects and scepticism of the abilities of AI. If nothing else the AI has a big advantage because it would have read and possibly remembered the text of the bill and could answer specific questions which already gives it a massive edge over its geriatric competition. The politicians lie proactively with plausible deniability and/or people wilfully ignoring it because of team dynamics. Something like ChatGPT is hard to train to lie without it being demonstrable with experimental evidence.
- dmreedy 4y ago> Something like ChatGPT is hard to train to lie without it being demonstrable with experimental evidence. See, I consider the functional definition of what current generation LLMs do to be "lying". Not out of malice or moral failing (of the model or the model's creators), but simply out of lack of control/alignment/modulation systems that people typically associate with honesty, integrity, and intention. The problem-model behind these systems is "predict what comes next". The objective in training is not accuracy of content (by whatever definition...), but verisimilitude of output. An LLM happily improvises on whatever seed you give it. Sometimes this leads to output that aligns with someone's definition of reality. Sometimes it's hallucination or bullshit or garbage or whatever you term you want to use for it. You can modulate this with better prompt engineering, but only by degrees. I have no doubt future generations of these systems will start tackling this, but the systems as they stand now are by their very nature, liars. edit: And additionally, while I can't necessarily argue against your trust in these systems (especially given the choice you presented.. I'd probably choose XGPT too), "neutrality" is defined by a shared trust that I don't see a route to in the current climate.
- ElevenLathe 4y agoI agree that lawmaking has never been a process under any kind of statistical control, and so its hard to say what any change to the system is really doing. That said, I can only really agree that it might be a net good IF the weights (and all other data necessary to reproduce the summaries) were open knowledge. Without that, you are just shipping a bill off to a black box and trusting that the gremlins in the box are acting in good faith. If every legislative office is doing this, then those gremlins will become the new focal point of a basically-invisible form of lobbying. This is good for OpenAI (and whoever controls it) but probably bad for everyone else.
- Centigonal 4y ago> ChatGPT can read a 4,000 page bill in 3 days. Can it, though? The context window is nowhere near 4,000 pages. Getting ChatGPT to understand and summarize such a long document seems nontrivial.
- shmel 4y agoAdd an intern in the loop that feeds every chapter separately and then compiles per-chapter summary that can then be summarized again if it is too long or has too many interdependencies.
- orbital-decay 4y agoIt probably can, assuming that a bill can be separated into smaller parts, more or less independent of each other. Trusting the summary is another story. But expecting people to read 4000 pages in 3 days and make informed decisions after that is unrealistic, regardless of whether they are using lossy untrusted compression tools like ChatGPT.
- nathan_compton 4y ago"Trusting the summary is another story." What story could we possibly be interested in that involves having chat GPT read a bill but we don't care about a summary of it being accurate?
- candiddevmike 4y agoAnd with most bills I've read, the devil is 100% in the details. Of those 4000 pages, it might just be one sentence that has far reaching ramifications. Alternatively, folks will start maliciously crafting bills in a way that the ChatGPT summary misses the key parts.
- disqard 4y agoThe new SEO will be LEO :) (AIO sounds less catchy)
- 4y ago
- juujian 4y agoI don't know about GPT 4, but I did not find GPT 3.5 great for summarizing long documents. I tried it on two long that I knew the content on, and it did not pick up the main themes well. Not even well enough that it would be believable at a glimpse, but I would be more concerned if it was believable and used as the basis of a debate. GPT 4 should do a little bit better in that regard, since it allows for longer input strings, but still not long enough to properly process 4,000 pages.
- notahacker 4y ago> It'll probably be a net win once the dust settles if it makes it harder to ram stuff through without debate Or make it worse, because it completely normalises the practice of foisting long revisions on people at the last minute "you had plenty of time to understand it; my computer read it in seconds!" and encourages people rely more on tooling than dividing reading text between themselves and people they trust who (unlike GPT) have a shared interest in achieving particular goals and protecting particular parties. From what we've seen current gen summarising tools aren't particularly accurate at summarising legal documents, never mind highlighting stuff which is politically sensitive, and that's before we get into clauses inserted adversarially by entities who have the same tools to test whether GPT summaries pick them up
- disqard 4y agoYour comment reminds me of how HFT is now in a similar regime -- speed is everything, and whoever can trade with the lowest latency, wins.
- dragonwriter 4y ago> ChatGPT can read a 4,000 page bill in 3 days So can the legislative staff of the committee of responsibility. > And it'll be a nice neutral way of arguing about what is in a bill - people might be able to agree on which AI is reasonable Ha ha ha ha. No. Just like they can’t do that with human experts, and for the same reason. Heck, this has already been demonstrated in the case of AI models quite resoundingly. And it would be a bad thing if they could: designating a single AI vendor as the sole arbiter of truth in the lawmaking process would be much worse than the status quo.
- nathan_compton 4y agoChatGPT _can't_ read a 4000 page bill in 3 days. It can't even read a 10 page not-very dense technical document without hallucinating wildly in its summary in my experience with ChatGPT4.
- AnimalMuppet 4y ago> ... people might be able to agree on which AI is reasonable and what it thinks the summary should be. We're going to wind up with ChatDNC and ChatRNC. Nobody in office is going to agree on which one is reasonable, for the same reason that they refuse to agree on anything today.
- defgeneric 4y ago> And it'll be a nice neutral way of arguing about what is in a bill - people might be able to agree on which AI is reasonable and what it thinks the summary should be. It's more likely that they'll further politicize these models.
- tzs 4y ago> I believe that for some of the largest expenditures of my lifetime the US Congress voted literally without people having read the final text bills they were voting on. Congress is similar to most other large organizations, such as large software companies. In a large company software company the upper level managers don't actually read all the code. They make their decisions based what managers below them report, and so on down the management chain. Representatives and Senators are Congress' equivalent to those upper level managers. The House has over 6000 staff members, ranging from staff working for individual representatives to staff employed by committees. The Senate has over 4000 staff members. Those are the people that deal with nitty gritty details of the bills.
- cyanydeez 4y agoYou know most of the cells in your body have no idea what your brain is thinking. There's no world in which you'll ever get an organism to know everything top down. So I have to assume the remaining conclusion you have is a naive understanding of organizational structure and super organisms.
- chii 4y agoThe problem with human 'super organism' is that nobody really wants to be the skin cells under the foot to be stepped on and sacrificed.