3 ms·
> I find the phrase "statistical analysis" a frustrating one nowadays as it seems to have become a signal for "I hold a particular philosophy of the mind". LLM
by Jensson 4y ago
> I find the phrase "statistical analysis" a frustrating one nowadays as it seems to have become a signal for "I hold a particular philosophy of the mind".
LLMs are trained to reproduce human text, that is different from for example AlphaGo that is trained to win Go games. Trained to reproduce data is what we mean with a statistical model, trained to win is how we got superhuman performance before, while trained to reproduce data performs worse than the original creators of the data.
- pixl97 4y agoThis is reductive in the sense is that things like AlphaGo were bad at Go for a very long time, and then with more compute power and algorithm changes suddenly they were far better. And the problem space for go is absolutely huge it is still an insignificant portion of the problem space for knowledge.