2 ms·

> It didn't invent or "figure out" the model. It discovered it, just like any other pattern it discovers. Sure, and why isn't discovering patterns "figuring it

• thomastjeffery 4y ago
  What can be done with "it" after "figuring out" is different for a person than for an LLM. A person can use a model to do any arbitrary thing they want to do. An LLM can use a model to follow the patterns that are already present in that model. It doesn't choose the pattern, either: it will start at whatever location in the model that the prompt is modeled into, and then follow whatever pattern is most obvious to follow from that position.
  • naasking 4y ago
    > An LLM can use a model to follow the patterns that are already present in that model. If that were true then it would not be effective at zero-shot learning. > It doesn't choose the pattern, either: it will start at whatever location in the model that the prompt is modeled into, and then follow whatever pattern is most obvious to follow from that position. Hmm, sounds like logical deduction...