11 ms·
ChatGPT is a bullshit generator but it can still be amazingly useful
- joshspankit 4y agoAren’t we all
- LesZedCB 4y agocan this title be de-editorialized? > ChatGPT is a bullshit generator. But it can still be amazingly useful
- dsabanin 4y agoAh, this title makes more sense. After all, humans are bullshit generators to, and can occasionally be useful.
- bamboozled 4y agoSo the thing is, we don’t want an automated bullshit generator ?
- teawrecks 4y agoOur scientists were so preoccupied with whether they could...
- dsabanin 4y agoIf seriously, it definitely does not just generate bullshit, and there is no indication that it's not going to improve dramatically in a few years, augmented by other models. You have to start somewhere. Google and others apparently have more powerful models already, but they don't release them. I remember days when reliable voice recognition was thought of as nearly impossible, and here we are. I believe that the "bullshit" part is a brief, temporary phase.
- orwin 4y agoI mean, I used Copilot more, but it's 99% bullshit. The only Ai I paid for was Wolfram Alpha and that's the only AI that outperform me. Even for dumb react code, it will use classes rather than hooks. It's basically useless with dynamically typed languages and use old syntaxes. I do not see the use case right now. At all.
- dsabanin 4y agoI think it also has something to do with the corpus – most JS/TS/React code is utter garbage. The model learned to code from inexperienced coders. I see different results in Scala, Dart, Rust, etc.
- dang 4y agoYes, I've reverted it now. Submitted title was "Princeton CS Prof: ChatGPT Is a Bullshit Generator (2022)". Submitters: "Please use the original title, unless it is misleading or linkbait; don't editorialize." - https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- nashashmi 4y agoAnd someone else realizes the errors and corrects them. -1 & 1 equal 2
- puma_ambit 4y agoThe problem with a lot of academics is that they think everything has to be perfect. That’s just not how the real world works. People have seen that it can be useful and that’s all it is for now it’s up to humans to decide whether it provides value or not. And yes, it will generate bullshit from time to time but like anything it’ll get better. I remember when they used to say the Internet wasn’t very useful too, look how that turned out.
- Jeff_Brown 4y agoGenerally agreed, but there is a certain hyperventilating demographic that needs to understand the limitation of today's AI.
- Gigachad 4y agoIf anything I think the average person doesn't realize just how good these new tools are. They think of them as a slightly better Siri until actually giving them a go.
- allknowingfrog 4y agoDid you read the article? It's a fairly balanced evaluation of the strengths and weaknesses of LLMs in general, and ChatGPT in particular.
- deleted 4y ago[deleted]
- hnthrowaway0315 4y agoConsidering many jobs need certain amount of bsing, I can see the bright future of ChatGPT.
- Iwan-Zotow 4y agoshould easy replace all politicians
- yodsanklai 4y agoActually, it's quite good at writing political speeches.
- LinuxBender 4y agoshould easy replace all politicians Maybe some of them. ChatGPT has already been show to have a political bias. [1][2] There are already a myriad of articles showing many forms of bias, only linking a couple of them. [1] - https://unherd.com/thepost/chatgpts-score-system-shows-political-bias-is-no-accident/ https://unherd.com/thepost/chatgpts-score-system-shows-polit... [2] - https://reason.com/2022/12/13/where-does-chatgpt-fall-on-the-political-compass/ https://reason.com/2022/12/13/where-does-chatgpt-fall-on-the...
- jeoqn 4y ago[flagged]
- hawthornio 4y agoChatGPT suggests factually correct or popular policies… The death penalty is objectively more expensive than life in prison, and the right to abortion is supported by a majority (in the US at least). You’re basically doing [a steven colbert bit](https://youtu.be/UwLjK9LFpeo https://youtu.be/UwLjK9LFpeo), but unironically.
- nivenkos 4y agoHow is the death penalty more expensive? Maybe in the USA where it's applied poorly and has huge waiting times, etc. But an expedited death penalty for repeat violent offenders would avoid a lot of issues. I doubt it's more expensive in China or Dubai for example.
- civilized 4y agoThe authors hypothesize that ChatGPT is useful for > Tasks where it’s easy for the user to check if the bot’s answer is correct, such as debugging help. I would qualify this fairly heavily. If your bug is "my program is throwing an error" or "FizzBuzz isn't producing the expected output", sure, a bot suggestion can be tested easily. But that's only the easiest kind of debugging, and without any deep appreciation of logic, I suspect it would tend to give you overly specific remedies that mask the problem or make new problems. "You want it to say FizzBuzz when n=15? How about if n=15 print FizzBuzz" In other words, what can be easily tested for correctness depends very heavily on how strong a grasp the user has on correctness in the domain. A novice without a good bullshit detector could be left worse off than if they had asked a person. It's not clear that the set of problems whose solution can truly be checked easily is all that big or useful. (I think our CS professor friends here are overgeneralizing from intuitions about P vs NP, a totally different context.) My two cents: it will be mainly useful as a different kind of search engine that can help you remember syntax, what does what, what parameters this thing needs, etc.
- sublinear 4y agob-but... I thought being technically correct was the best kind of correct! /s Seriously though thanks for articulating the tree-like nature of truth. Being an expert requires the ability to understand a topic at all levels in a consistent manner. ChatGPT just models the language, not the actual concepts.
- deleted 4y ago[deleted]
- tshaddox 4y agoIn other words, it disrupts classroom assignments where the student is being asked to produce bullshit but where historically the easiest way to produce that bullshit was via a process that was supposedly valuable to the student's education. The extent to which a teacher cannot distinguish a human-generated satisfactory essay from an essay generated by a bullshit generator is by definition precisely the extent to which the assignment is asking the student to generate bullshit. This will certainly require a lot of reworking of these traditional curriculums that consist heavily of asking the student to generate bullshit, but maybe that wasn't the best way to educate students this whole time.
- titzer 4y ago> This will certainly require a lot of reworking of these traditional curriculums that consist heavily of asking the student to generate bullshit, but maybe that wasn't the best way to educate students this whole time. Just curious which discipline you have a grudge against here. Because presumably disciplines are actually disciplines where someone working in the field for their entire career can spot BS.
- SpaghettiX 4y agoGP did not mention disciplines, and I don't think individual disciplines are to blame. The approach of evaluating students based on "text generation" is very boring to study for, easy to fool (a parent/guardian can do it, last year's students can pass you an A grade answer, ChatGPT can generate it) and doesn't prepare students for reality (making new things, solving new problems).
- picture 4y agoNot all of us can be making new things and solving new problems, however..
- xoac 4y agoWhat if the thing you are supposed to be making is written communication in the form of a document, or a book, or a paragraph explaining why production was down? What if the goal of these things was to make a student literate?
- zoba 4y agoEzra Klein covers ChatGPT & Bullshit on an episode of his podcast. The episode title is “A Skeptical Take on the A.I. Revolution” https://podcasts.apple.com/us/podcast/the-ezra-klein-show/id1548604447?i=1000592835492 https://podcasts.apple.com/us/podcast/the-ezra-klein-show/id...
- hoppyhoppy2 4y agoTranscript: https://www.nytimes.com/2023/01/06/podcasts/transcript-ezra-klein-interviews-gary-marcus.html https://www.nytimes.com/2023/01/06/podcasts/transcript-ezra-...
- resource0x 4y agoThe pot calling the kettle black
- westurner 4y agoPrompt engineering: https://en.wikipedia.org/wiki/Prompt_engineering https://en.wikipedia.org/wiki/Prompt_engineering /? inurl:awesome prompt engineering "llm" site:github.com https://www.google.com/search?q=inurl%3Aawesome+prompt+engineering+%22llm%22+site%3Agithub.com https://www.google.com/search?q=inurl%3Aawesome+prompt+engin... XAI: Explainable Artificial Intelligence & epistomology https://en.wikipedia.org/wiki/Explainable_artificial_intelligence https://en.wikipedia.org/wiki/Explainable_artificial_intelli... : > Explainable AI (XAI), or Interpretable AI, or Explainable Machine Learning (XML), [1] is artificial intelligence (AI) in which humans can understand the decisions or predictions made by the AI. [2] It contrasts with the "black box" concept in machine learning where even its designers cannot explain why an AI arrived at a specific decision. [3][4] By refining the mental models of users of AI-powered systems and dismantling their misconceptions, XAI promises to help users perform more effectively. [5] XAI may be an implementation of the social _ right to explanation _. [6] XAI is relevant even if there is no legal right or regulatory requirement. For example, XAI can improve the user experience of a product or service by helping end users trust that the AI is making good decisions. This way the aim of XAI is to explain what has been done, what is done right now, what will be done next and unveil the information the actions are based on. [7] These characteristics make it possible (i) to confirm existing knowledge (ii) to challenge existing knowledge and (iii) to generate new assumptions. [8] Right to explanation: https://en.wikipedia.org/wiki/Right_to_explanation https://en.wikipedia.org/wiki/Right_to_explanation (Edit; all human) /? awesome "explainable ai" https://www.google.com/search?q=awesome+%22explainable+ai%22 https://www.google.com/search?q=awesome+%22explainable+ai%22 - (Many other great resources) - https://github.com/neomatrix369/awesome-ai-ml-dl/blob/master/data/model-analysis-interpretation-explainability.md#post-model-creation-analysis-ml-interpretationexplainability https://github.com/neomatrix369/awesome-ai-ml-dl/blob/master... : > Post model-creation analysis, ML interpretation/explainability /? awesome "explainable ai" "XAI" https://www.google.com/search?q=awesome+%22explainable+ai%22+%22XAI%22 https://www.google.com/search?q=awesome+%22explainable+ai%22...
- titzer 4y agoI for one rue this commandeering of the word "engineering". No, most activities involving stuff are not "engineering". Especially flailing weakly from a distance at an impenetrable tangle of statistical correlations. What a disservice we are doing ourselves.
- aatd86 4y agoHaving half of the title is too triggering. That's not fair to the CS prof. Misleading. But to comment on the article, although I've encountered several falsities in chatgpt output, I'm still very surprised that it could devise algorithms when I would give him the criteria. And it would even output some code samples. It shouldn't be underestimated as a programming aid.
- angst_ridden 4y agoChatGPT sometimes reminds me of a junior programmer. I asked for a code example of clipping a polygonal shape with another polygonal shape, and it wrote code that just deleted vertices from the subject polygon that were outside the clipping polygon. Interestingly, the correctness of the code it generated depended on which language I asked for it to generate the code in. I assume that says something about the corpus of code it analyzed and the relative quality between the languages.
- joshspankit 4y agoI’m now curious. Anyone up for doing a breakdown of ChatGPT correctness vs generated language?
- zaptrem 4y agoIn which languages were the results correct? I would assume Python as I've been told it was more prevalent in the training corpus.
- more_corn 4y agoAnd therefore has demonstrated that 90% of modern life and work are bullshit.
- kilgnad 4y agochatGPT is a reflection of those who trained it (not openAI but the actual ground level people hired to label answers). It generates bullshit because a lot of bullshit was approved during training.
- IncRnd 4y agoIt generates bullshit, because it regurgitates information without understanding the meaning or interconnectedness of that information.
- kilgnad 4y agoThat doesn't explain why the bullshit is often completely true and accurate. Sometimes it's wrong, sometimes it's right. But when it's wrong it produces an answer remarkably realistic and close to a right answer. This indicates understanding... as a form of understanding is still required to lie and it is definitely required to tell the truth. Chatgpt is simply not trained to differentiate truth from lie. But the truth does exist somewhere in that neural net.
- IncRnd 4y agoThere is no need to explain why bullshit is sometimes true and accurate. It's bullshit. It's not an indication of understanding, not at all. It's an indication of regurgitated information without an understanding of the meaning or the interconnectedness of that information. ---- OpenAI Announces Exciting New Technology for Developing Fidget Spinners in Collaboration with The Fiends of Silicon Valley San Francisco, CA - OpenAI, a leading artificial intelligence research organization, is proud to announce its latest breakthrough in technology development: a collaboration with The Fiends of Silicon Valley, a consortium of some of the biggest names in tech, including Apple, Microsoft, IBM, and leading social media websites, to revolutionize the fidget spinner market. The fidget spinner craze has taken the world by storm, with millions of people turning to these simple toys for stress relief and as a way to focus their minds. OpenAI, in partnership with The Fiends of Silicon Valley, is set to take this trend to the next level with the development of smart fidget spinners that can sense, react to, and interact with their environment. These cutting-edge fidget spinners will be equipped with a range of advanced sensors, including motion detectors, gyroscopes, and accelerometers, to provide a truly immersive experience. The spinners will be powered by OpenAI's advanced machine learning algorithms, which will learn the user's spinning habits and preferences over time, providing customized spinning experiences that are unique to each individual. In addition to their innovative technology, the fidget spinners will be sleek and stylish, with a range of colors and designs to choose from. They will also be available at affordable prices, making them accessible to a wider audience than ever before. "We're excited to be working with The Fiends of Silicon Valley to bring our latest technology to the fidget spinner market," said OpenAI CEO Sam Altman. "Our goal is to provide users with a truly unique and personalized experience that combines the benefits of fidgeting with the latest advancements in artificial intelligence." The Fiends of Silicon Valley expressed their excitement about the partnership, saying, "The combination of our technological expertise and OpenAI's cutting-edge algorithms will bring a new level of interactivity and customization to the fidget spinner market. We're thrilled to be part of this groundbreaking project." The smart fidget spinners are set to hit the market later this year and are expected to be in high demand. OpenAI and The Fiends of Silicon Valley are confident that they will change the way people think about fidget spinners forever. About OpenAI OpenAI is a leading artificial intelligence research organization dedicated to advancing artificial intelligence in a responsible and sustainable way. Founded in 2015, the company is dedicated to creating cutting-edge technologies that have the potential to transform industries and improve the lives of people around the world. About The Fiends of Silicon Valley The Fiends of Silicon Valley is a consortium of some of the biggest names in tech, including Apple, Microsoft, IBM, and leading social media websites. The consortium is committed to exploring new technologies and business opportunities in the field of artificial intelligence. For more information on OpenAI's new fidget spinner technology and The Fiends of Silicon Valley consortium, please visit their websites.
- pessimizer 4y agohttps://archive.org/details/Babble_1020 https://archive.org/details/Babble_1020 > Babble! is a toy for people who love words. > Babble! takes samples of text from various sources, analyzes them for style and content, mixes them together in varying proportions, and then...well...babbles. On and on. Endlessly. If you take its samples away, it still babbles. That's what Babble! does. It babbles! > By mixing up words and ideas, and by finding connections which are not obvious to the naked mind, Babble! is useful as a creative tool and as a cure for writer's block. It can scramble ideas in brainstorming sessions like nobody's business. It will compose advertising copy, overdue marketing plans, and official government reports. It'll generate text in the style of whomever you please for use in school papers, public speeches, and contests in New York Magazine. It can be used to produce brochures, press releases, newsletters, letters to the editor, and letters to John Dvorak. It's great for answering all that pesky Email as well as any other electronic communications, and it's also been used to document source code and write program manuals (like this one, for example). > We tried it on legal boilerplate, but the stuff that came out sounded just like the stuff that went in!
- amelius 4y agoPerhaps somebody can make an app that babbles to the user until they fall asleep.
- mirekrusin 4y agoOh no, another dude on the internet discovered that chatgpt doesn't write truth and only truth.
- lexarflash8g 4y agoIf you want analytical information then I could see a use-case for GPT-3. I was trying to sign up for health insurance and asked questions -- it didn't give good answers. Sometimes you need a human to help you with it -- so these tools will save money in the long run but not have the "street smarts". Can I use an AI tool to tell me how to fix my bike? If I dunno much about bikes an expert has to look at it and tell me what's wrong..
- gsatic 4y agoIt's the age of bullshit. And whats surprising is the focus is on generating/building bullshit, pointing it out or justifying it. There doesn't seem to be a single person anywhere whose isn't caught up in this superficial gilded cage trap. Individuals need to rethink and reset their own compasses or where groups are heading is total meaninglessness.
- abhv 4y agoPerfectly conceivable that Arvind is punking us all by using an Llm to write that essay. Very basic stuff for someone who usually has subtle points to make.
- denkmoon 4y agoBeing a bullshit generator is exactly why it is so threatening for most jobs
- alexruf 4y agoCan confirm that. I asked ChatGPT for information about a book my son was reading at school. While the answer sounded really good at first sight, the content was absolutely nonsense. Not a single statement from ChatGPT was correct. Therefore, I can confirm - it’s bullshit.
- Gigachad 4y agoThey seem to be reeling it in, I've seen it say more often that it doesn't know or that it isn't reliable for a particular query. Tbh I wish It would just have a go anyway.
- deleted 4y ago[deleted]
- mikewarot 4y agoIt might help quite a bit to watch this overview of how ChatGPT works, and especially how it was trained.[1] Human attention was too expensive for the training, so they made another AI to simulate the trainers. Unfortunately, the trainer simulator training didn't have an expressive enough set of options for the actual humans, which kept a lot of quite valuable feedback out of the whole system by reducing things to single ranking. If the person didn't know the correct answer, they'd likely just go based on gut. This in turn lead the training simulator to do the same. This lead ChatGPT to just try to bullshit an answer rather than stating it didn't know, and getting downvoted. [1] https://www.youtube.com/watch?v=viJt_DXTfwA https://www.youtube.com/watch?v=viJt_DXTfwA
- OhNoNotAgain_99 4y ago[dead]
- deleted 4y ago[deleted]
- amai 4y agoRelevant reading; https://en.wikipedia.org/wiki/On_Bullshit https://en.wikipedia.org/wiki/On_Bullshit https://www.callingbullshit.org/ https://www.callingbullshit.org/ https://en.wikipedia.org/wiki/Bullshit_Jobs https://en.wikipedia.org/wiki/Bullshit_Jobs