3 ms·

I see the source of your confusion. LLMs are not actually zips of the training dataset.

• krainboltgreene 3y ago
  It is an incredibly common refrain amongst experts in the field that it is a compression of the dataset. But that doesn't matter, because you clearly didn't understand what I was writing which doesn't shock me considering your position on LLMs.
  • valine 3y ago
    > It is an incredibly common refrain amongst experts in the field that it is a compression of the dataset This was a common idea three years ago. No one in the field seriously believes this today.
    • krainboltgreene 3y ago
      You're going to have to let a lot of scientists know that, because they're still publishing papers with that understanding. I guess they should have consulted you first.
      • valine 3y ago
        Not their fault, hindsight is 20/20.