3 ms·
While I like to joke about Google products failing as much as the next guy, you've got to give them credit for mostly being focused on research and publishing t
by sva_ 4y ago
While I like to joke about Google products failing as much as the next guy, you've got to give them credit for mostly being focused on research and publishing their results publicly.
Other than, you know, a company that calls themselves "Open"AI, who now even consider it too dangerous (due to competition), to even release the number of parameters of their most recent model, much less talk about the actual research.
- TechBro8615 4y agoWhy should we give them credit for failing to build a working product and instead spamming research papers to conferences?
- chris_va 4y agoHm, and what do you think begat all of this LLM fun in the first place?
- inerte 4y agoVery coincidentally I am trying to understand AI better, and I am reading "Regular Expression Puzzles and AI Coding Assistants" and it says on its first few pages: Due to transformer deep neural networks mostly pushed forward to a 2017 paper called "Attention is all you need". Prompted by your question I searched where the people who wrote this paper work at, and... (unsurprisingly drum roll), a team from Google.
- kccqzy 4y agoIt is well-known that Google had world-class researchers working on AI for a long time now, and that they pioneered a lot of techniques used in the recent AI craze.
- TechBro8615 4y agoAnd yet they have nothing to show for it other than some words on paper. Meanwhile OpenAI is eating their lunch by offering an actual product that people can use and interact with. Nobody cares that Google did the research they used to make it. Talk is cheap.
- potatoman22 4y agoTheir AI efforts go towards google search and ads.
- zamnos 4y agoI don't think it's that well known, and for an advertising company, Google's marketing department doesn't seem very good. For instance, Google translate has been an ML model for more than a decade. They dropped a bunch of hand written code and replaced it with a model. The Google home assistants use an ML model to do their speech to text transcription. Google's tensor hardware is world class for ML research. But all people say is that Google search sucks now and wah they killed off Reader/Stadia/etc. Transformers will possibly have a bigger effect on society than Google search did and I'm doubtful Google will get proper recognition for that outside of circles like ours.
- kccqzy 4y ago> Transformers will possibly have a bigger effect on society than Google search did and I'm doubtful Google will get proper recognition for that outside of circles like ours. Do you think the general public gives Xerox PARC a lot of credit for modern computing? I don't think so, and it's fine. It will just be well known among technology enthusiasts and historians of technology.
- zamnos 4y agoIt actually does bother me when people refer to Xerox as a failed photocopy machine company without acknowledging PARC, but I'm aware I'm in the minority here. I also think The Dream Machine should be required reading in a history class in all CS curriculum, but I'm not in academia. https://www.goodreads.com/en/book/show/722412 https://www.goodreads.com/en/book/show/722412
- saagarjha 4y ago> had
- paxys 4y agoIt seems clear that the recent golden age of AI research is behind us. OpenAI fired the first shot, and now every company is scrambling to put every dollar out of their budget into productization/weaponization of the tech. There is zero incentive for anyone to publish papers, models and weights now that guarding them as trade secrets is infinitely more valuable. It isn't researchers calling the shots now but but PMs.
- zenocon 4y agoThis guy gets it.