2 ms·

Quite intuitive. Let's heart those "just a next token predictor" cries now.

• ex-aws-dude 13d ago
  I never understand when people say that, isn’t it obvious that intelligence is an emergent phenomenon that could arise in different ways
  • lolakutty 12d ago
    Sure, but it is a token predictor, and it is not intelligent not because it works by predicting a token, but it shows dumb behavior... LLMs are a great search tool. It searches connections in the collective human knowledge that humans have written down through all the years.... They are very good at it, and that is about it.
    • ex-aws-dude 12d ago
      Putting LLMs in loops with tool calls has created tons of emergent behaviour beyond simply being a search tool
      • ghawkopen 12d ago
        Do you have any examples of this?
      • lolakutty 12d ago
        If you search randomness, you ll get any behavior that you can imagine. That does not mean that the tool is NOT doing a search. In the case of LLMs, it is not searching the whole of the randomness, but instead it just search among the grammatically correct sentences that is consistent with the existing patterns found in the existing written down human knowledge.
        • ex-aws-dude 12d ago
          The thing is searching an associative memory for similar solutions and predicting what will work is not that far off conceptually from what humans do I don’t think LLMs will reach the same level as humans but I would argue it is still a form of limited intelligence It’s not a binary thing
          • lolakutty 12d ago
            It is not Intelligence. It is pattern matching. https://news.ycombinator.com/item?id=49694427 https://news.ycombinator.com/item?id=49694427
  • fangspire 12d ago
    It's not obvious that a text generator is intelligent.
• lolakutty 12d ago
  Those cries are the corrective reaction to cries of "We are Artificial super GI now!" And yes, it is just a next token predictor.