4 ms·

Nothing in your comment argues against it being surmountable

• dartos 2y ago
  Nothing in my comment argues against the existence of bees either. I have some opinions on the matter, but arguments about unfalsifiable traits aren’t really useful, especially since you’re not going to be convinced, nor I. I don’t personally believe that we’ll get much further with regards to general intelligence with statistical models, specifically. I think a lot of the purported progress towards “intelligence” is personification bias and a little bit of p-hacking. Many of the papers that are published and spread aren’t peer-reviewed or all that reproducible. We’ll probably see some very useful models made soon which focus on narrower text generation tasks and achieve pretty good results.
  • snapcaster 2y ago
    >We’ll probably see some very useful models made soon which focus on narrower text generation tasks and achieve pretty good results. isn't this surmounting the problem? Also aren't there a whole range of techniques already developed to handle hallucinations? I'm not sure what you think is the showstopper here?
    • dartos 2y ago
      > isn't this surmounting the problem? I’m sorry, I’m not really sure what you mean by this. There are techniques to lower the rate of hallucinations, but not solve it. Those techniques also vary wildly from application to application. So, no. There are no general viable techniques to totally avoid hallucinations.
      • snapcaster 2y ago
        but totally avoiding isn't necessary? My company is using LLMs in production across a wide range of features right now so i'm not just speaking theoretically edit: including in cases where outputs need to meet strict constraints