4 ms·
> what the analogy to "radioactive fallout" will be from LLMs I think we're already seeing it. People don't understand that an LLM is just a text generator and
by donkeyd 4y ago
> what the analogy to "radioactive fallout" will be from LLMs
I think we're already seeing it. People don't understand that an LLM is just a text generator and add value to what the LLM says. See the article below for such an example.
https://www.vice.com/en/article/pkadgm/man-dies-by-suicide-after-talking-with-ai-chatbot-widow-says https://www.vice.com/en/article/pkadgm/man-dies-by-suicide-a...
- waboremo 4y agoHorrifying story, it really doesn't take much, and I'm sure a lot of people feel the same way to "Pierre" in the article - overwhelmed by all the catastrophic news and events. As I was reading that, the image where "Eliza" describes methods of suicide was so bizarre to me. I thought what an absurd tone change bordering on dark comedy, and then caught myself, I was doing exactly that adding value and assumptions based on online human interaction to a "text generator". It's going to be an interesting experience as more LLMs become humanized, by naming them, using 3D models or preset video animations, text to speech generation, more personalization to the prompt creator, etc. and that line becomes increasingly blurry for folks.
- jquery 4y agoWhat do you mean "just a text generator?" GPT-4 is capable of doing emergent things that were not present in the training dataset.
- coldcode 4y agoI would like to see that topic covered in more detail. I can't see how something that essentially figures out what the next word should be can create something new, without actually understanding the real world.
- anybodyz 4y agoI would recommend getting an account and simply testing it directly. It's fairly easy to demonstrate that it operates at a conceptual level and is not merely predicting word probabilities in a simplistic way. A good example with GPT is to watch it do complex math. There are simply too many permutations of math solutions for it to have ever memorized, and it can easily explain its process and the path it took to arrive at a solution. Another good set of tests are ones around theory of mind, complex deduction problems and missing information, etc. A good source of information about the precise capabilities of GPT-4 is the Microsoft Sparks paper, which goes into a good number of tests MS researchers put the model to.
- JieJie 4y agoSabine Hossenfelder has a video that goes into LLM's ability to "understand"[0]. Stephen Wolfram also has one or two articles about GPT-4's emergent abilities.[1][2] [0] https://www.youtube.com/watch?v=cP5zGh2fui0 https://www.youtube.com/watch?v=cP5zGh2fui0 [1] https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-... [2] https://writings.stephenwolfram.com/2023/03/chatgpt-gets-its-wolfram-superpowers/ https://writings.stephenwolfram.com/2023/03/chatgpt-gets-its...
- ltbarcly3 4y agoHumans adapt to technology as much as we adapt technology to us. Modern humans are much better at tasks like manipulating symbolic information, digesting starch, and avoiding alcohol addiction than a random person 100,000 years ago. In 100 years we might add "not being talked into suicide by robots" to that list.
- jquery 4y agoHopefully in the next 5-10 years we can add "not believing everything they read on social media" to the list.