3 ms·
Language models predate Google by 10+ years. I found references dating as far as 1987. https://scholar.google.com/scholar?q=%22language+model%22+&hl=en&as_sdt=
by visarga 4y ago
Language models predate Google by 10+ years. I found references dating as far as 1987.
https://scholar.google.com/scholar?q=%22language+model%22+&hl=en&as_sdt=0%2C5&as_ylo=1980&as_yhi=1990 https://scholar.google.com/scholar?q=%22language+model%22+&h...
- fzimmermann 4y agoReading the parent in the most favorable light: "Attention is all you need" can be seen as a fundamental paper for the current LLM generation, which indeed came out of google brain..
- visarga 4y agoOk, so you restrict the definition to transformers. The people who invented the transformers left Google years ago, making their own startups. Only one still works at Google. That means Google doesn't have the most creative researchers anymore.
- wodenokoto 4y agoOkay, by that logic they also invented search.
- ben_w 4y agoIf you like. (Larry) PageRank being so much better than the previous best is why Google became the megacorp it is today.