3 ms·

An LLM only trained on exam papers wouldn't even be an LLM. You said above: > I do not recall the lesson wherein I sampled from thousands of prior exam papers

An LLM only trained on exam papers wouldn't even be an LLM. You said above: > I do not recall the lesson wherein I sampled from thousands of prior exam papers to generate my answer to the one I sat. No. You instead sampled from thousands of prior conversations, textbooks, story books, movies, songs... to form how you write, how you think, how you understand. What ever you studied specifically for that exam wasn't even the tip of the iceberg of what was required to write your answers, even understanding that what you studied was predicated on the efforts of others in a way that makes your weeks of cramming infinitesimally small in the scale of effort that goes into writing a single answer on that test.

mjburgess 3y ago
You will find no such things in the body or the brain this dumb 'statisticalism' is false-- and a product just of the impulse for engineers to misexplain reality on the basis of their latest engineering successes animals grow representations of their environments which are not summarises of cases --- they're sensory motor adaptions which enable coordination of the body and mind in every sense
- BoorishBears 3y ago
  You're responding to a comment no one wrote, the point wasn't to state about how those representations are formed: it was that you integrate many many environments to do anything useful. If someone were kept isolated enough from birth, regardless of inate intelligence they wouldn't be able to take that exam even if we gave them a year and make it open book: Genie took half a decade to reach a 2 year old's language skills. But there's also a certain irony in your dig on engineers mis-explaining while trying to paint the links between "sensory motor adaptations [sic]" and statisticalism as a response to recent engineering successes... https://pubmed.ncbi.nlm.nih.gov/16807063/ https://pubmed.ncbi.nlm.nih.gov/16807063/

mjburgess 3y ago

You will find no such things in the body or the brain this dumb 'statisticalism' is false-- and a product just of the impulse for engineers to misexplain reality on the basis of their latest engineering successes animals grow representations of their environments which are not summarises of cases --- they're sensory motor adaptions which enable coordination of the body and mind in every sense

BoorishBears 3y ago
You're responding to a comment no one wrote, the point wasn't to state about how those representations are formed: it was that you integrate many many environments to do anything useful. If someone were kept isolated enough from birth, regardless of inate intelligence they wouldn't be able to take that exam even if we gave them a year and make it open book: Genie took half a decade to reach a 2 year old's language skills. But there's also a certain irony in your dig on engineers mis-explaining while trying to paint the links between "sensory motor adaptations [sic]" and statisticalism as a response to recent engineering successes... https://pubmed.ncbi.nlm.nih.gov/16807063/ https://pubmed.ncbi.nlm.nih.gov/16807063/