15 ms·

> I really don't understand why people think it's some insurmountable wall. People do hallucinate in the same way llm-s do. Go talk to some real people. A pers

by dartos 2y ago

> I really don't understand why people think it's some insurmountable wall. People do hallucinate in the same way llm-s do. Go talk to some real people. A person making a mistake is not similar to a statistical model’s prediction not matching reality. It’s weird that you think probabilistic a text generator is even nearly comparable to an organic brain (let alone a human) It’s like comparing a wax statue with flesh and blood. They may look similar, they last a lot longer, but they’re not comparable. You’ve fallen totally into personification bias. I hope you find your way out.

snapcaster 2y ago
Nothing in your comment argues against it being surmountable
- dartos 2y ago
  Nothing in my comment argues against the existence of bees either. I have some opinions on the matter, but arguments about unfalsifiable traits aren’t really useful, especially since you’re not going to be convinced, nor I. I don’t personally believe that we’ll get much further with regards to general intelligence with statistical models, specifically. I think a lot of the purported progress towards “intelligence” is personification bias and a little bit of p-hacking. Many of the papers that are published and spread aren’t peer-reviewed or all that reproducible. We’ll probably see some very useful models made soon which focus on narrower text generation tasks and achieve pretty good results.
  - snapcaster 2y ago
    >We’ll probably see some very useful models made soon which focus on narrower text generation tasks and achieve pretty good results. isn't this surmounting the problem? Also aren't there a whole range of techniques already developed to handle hallucinations? I'm not sure what you think is the showstopper here?
    - dartos 2y ago
      > isn't this surmounting the problem? I’m sorry, I’m not really sure what you mean by this. There are techniques to lower the rate of hallucinations, but not solve it. Those techniques also vary wildly from application to application. So, no. There are no general viable techniques to totally avoid hallucinations.
      - snapcaster 2y ago
        but totally avoiding isn't necessary? My company is using LLMs in production across a wide range of features right now so i'm not just speaking theoretically edit: including in cases where outputs need to meet strict constraints

by dartos 2y ago

snapcaster 2y ago

Nothing in your comment argues against it being surmountable

dartos 2y ago
Nothing in my comment argues against the existence of bees either. I have some opinions on the matter, but arguments about unfalsifiable traits aren’t really useful, especially since you’re not going to be convinced, nor I. I don’t personally believe that we’ll get much further with regards to general intelligence with statistical models, specifically. I think a lot of the purported progress towards “intelligence” is personification bias and a little bit of p-hacking. Many of the papers that are published and spread aren’t peer-reviewed or all that reproducible. We’ll probably see some very useful models made soon which focus on narrower text generation tasks and achieve pretty good results.
- snapcaster 2y ago
  >We’ll probably see some very useful models made soon which focus on narrower text generation tasks and achieve pretty good results. isn't this surmounting the problem? Also aren't there a whole range of techniques already developed to handle hallucinations? I'm not sure what you think is the showstopper here?
  - dartos 2y ago
    > isn't this surmounting the problem? I’m sorry, I’m not really sure what you mean by this. There are techniques to lower the rate of hallucinations, but not solve it. Those techniques also vary wildly from application to application. So, no. There are no general viable techniques to totally avoid hallucinations.
    - snapcaster 2y ago
      but totally avoiding isn't necessary? My company is using LLMs in production across a wide range of features right now so i'm not just speaking theoretically edit: including in cases where outputs need to meet strict constraints