4 ms·
I would say it was discovered, not invented. People were messing around with some algorithms, intruiged by their results. Eventually researchers discovered that
by matusp 10mo ago
I would say it was discovered, not invented. People were messing around with some algorithms, intruiged by their results. Eventually researchers discovered that with using certain training algorithm with certain data can lead to really wonderful outputs. But this is pure empirical discovery.
No AI researcher from 2010 would predict that transformer architecture (if we could send them the description back in time), SGD, and Web crawling could lead to a very coherent and useful LMs.
- kreetx 10mo agoYup. LLMs are a big statistical model, where also any sub-part doesn't know the whole. If it's really similar to a brain, I guess we might say we discovered it. But if it isn't, we invented it. The fact that it is so useful doesn't have to mean that "it arrived".