3 ms·
Ironic you say this given that Google is the one to invent language models to begin with and GitHub was an acquisition. I personally don’t think there have bee
by endisneigh 4y ago
Ironic you say this given that Google is the one to invent language models to begin with and GitHub was an acquisition.
I personally don’t think there have been any amazing consumer tech breakthroughs by any big tech in the last 5 years.
- visarga 4y agoLanguage models predate Google by 10+ years. I found references dating as far as 1987. https://scholar.google.com/scholar?q=%22language+model%22+&hl=en&as_sdt=0%2C5&as_ylo=1980&as_yhi=1990 https://scholar.google.com/scholar?q=%22language+model%22+&h...
- fzimmermann 4y agoReading the parent in the most favorable light: "Attention is all you need" can be seen as a fundamental paper for the current LLM generation, which indeed came out of google brain..
- visarga 4y agoOk, so you restrict the definition to transformers. The people who invented the transformers left Google years ago, making their own startups. Only one still works at Google. That means Google doesn't have the most creative researchers anymore.
- wodenokoto 4y agoOkay, by that logic they also invented search.
- ben_w 4y agoIf you like. (Larry) PageRank being so much better than the previous best is why Google became the megacorp it is today.
- norswap 4y agoSome of Google's biggest successes are YouTube and Android, which were both acquisitions.
- mensetmanusman 4y agoMaybe you have misunderestimated chatGPT, I am already using it for work…
- adamsmith143 4y ago>Ironic you say this given that Google is the one to invent language models to begin Specifically by Google Brain, which is really quite different from the rest of the company. It's one of the top AI research labs in the entire world.