3 ms·
I'm gonna make a wild, flying leap prediction here. There's a thousand pound gorilla that hasn't made a peep about LLMs. That same gorilla has digitized the la
by noduerme 4y ago
I'm gonna make a wild, flying leap prediction here.
There's a thousand pound gorilla that hasn't made a peep about LLMs. That same gorilla has digitized the largest corpus of text on earth, and controls the first or second largest private sector server infrastructure on the planet. They also have talking devices and assorted IoT stuff everywhere. They have the monitoring and live feedback infrastructure (read: Eavesdropping) to improve performance on a much faster timeline.
My prediction is that Amazon all but killed Alexa to focus on building a usable home LLM-type assistant for the masses, and is holding its fire waiting to see how the first generation of essentially toy LLM demos is digested by the press and the public during this Google/Microsoft war.
- mtlmtlmtlmtl 4y agoWe've taken care of everything The words you hear, the songs you sing The pictures that give pleasure to your eyes It's one for all and all for one We work together, common sons Never need to wonder how or why We are the priests of the temples of Syrinx Our great computers fill the hallowed halls We are the priests of the temples of Syrinx All the gifts of life are held within our walls
- bsenftner 4y agoAh, fellow greybeards, recognize the AOR master? https://www.youtube.com/watch?v=RtdKhwhAcd4 https://www.youtube.com/watch?v=RtdKhwhAcd4
- sebzim4500 4y agoI don't think Amazon is that good at keeping secrets though. Every big project they start leaks immediately. EDIT: I wonder how the total size of Amazon's ebook library compares to the pile. Back of the envelope calculations suggest it should be the same order of magnitude.
- screye 4y agoAmazon has been unable to hire LLM/transformers talent for a good 5 years now. They might have terrific data, but Amazon has always been a little behind on NLP research.
- noduerme 4y agoCurious... Why would they be a bad place for that talent to go? Just their corporate culture? Facebook managed to build a LLaMa, and they're notorious...
- xkapastel 4y agoAmazon did release a 20B transformer called Alexa last year: https://www.amazon.science/blog/20b-parameter-alexa-model-sets-new-marks-in-few-shot-learning https://www.amazon.science/blog/20b-parameter-alexa-model-se...
- onlyrealcuzzo 4y agoAt least in late 2021 - Google by itself was substantially bigger than Amazon + AWS in terms of data centers. In terms of private text, FB is orders of magnitude ahead of Amazon. Amazon is not a 1000 pound gorilla in this space. It's just another player in a game for 5.
- ALittleLight 4y agoIt was never clear to me how many books went into training GPT et al. One area where Amazon might have an advantage is if they are able to train on their library of eBooks.