4 ms·
1) It's not possible to fairly compare human intelligence with something that can memorize gigabytes of text and hold it in non-volatile memory. 2) Months ago,
by civilized 4y ago
1) It's not possible to fairly compare human intelligence with something that can memorize gigabytes of text and hold it in non-volatile memory.
2) Months ago, in my earliest interactions with ChatGPT, I asked it to solve math problems. It gave me back stuff with LaTeX formatting. Obviously it had, if not these exact problems, similar templates in its training set.
Recently it was shown that GPT is completely incapable of solving Codeforces problems that appeared after it was trained.
Whatever is going on here is interesting but less impressive than it looks.
- munchler 4y ago1) Do you really think ChatGPT works by memorizing quantum mechanics textbooks? There are only 355 billion parameters in GPT-3.5, which is several orders of magnitude less than the 600 trillion synapses in the human brain. 2) Your conclusion is unfounded. ChatGPT speaks many languages, including Latex.
- civilized 4y agoBeautiful theory, meet ugly fact: https://aisnakeoil.substack.com/p/gpt-4-and-professional-benchmarks https://aisnakeoil.substack.com/p/gpt-4-and-professional-ben...
- Sharlin 4y ago> It gave me back stuff with LaTeX formatting. So? It can write LaTeX just like it can write Java or Python or Rust.
- civilized 4y agoIt put LaTeX in there unbidden because it pattern matched to LaTeX source code in its training set. Code containing solved math problems similar to those it was being asked.