4 ms·
So far, Google's missed opportunity to create GPT-3 doesn't fee like much of a setback. They're at least neck-and-neck with GPT-4, and in some areas (e.g. milli
by xnx 3y ago
So far, Google's missed opportunity to create GPT-3 doesn't fee like much of a setback. They're at least neck-and-neck with GPT-4, and in some areas (e.g. million token context window) clearly ahead.
- ZiiS 3y agoSeems reasonable if Google had made GPT-3 when they had their own hardware, the biggest datasets, the most money, the best people, had invented a lot of the science then everyone else may have decided not to compete, and they wouldn't only be neck-and-neck with a young startup.
- swyx 3y agothey have definitely caught up and then some. still feel like there’s interesting organizational lessons here to be learned, that is less about google and just more about how to take research bets for any company, especially a large company, especially a company accused of being too comfortable/egalitarian
- xnx 3y agoIt is curious that Google was able to make moonshots in areas outside their direct expertise (balloons, glucose-reading contact lenses, etc.) but maybe not to the same degree in AI.
- swyx 3y agoi mean the order of magnitude of money going into those things was probably pocket change whereas in AI there were real billions being horse traded. not the same stakes.
- calderknight 3y agoTo be clear, the best available version of Gemini has barely caught up with what OpenAI released over a year ago. Google's a year behind. They haven't really caught up.
- aantix 3y agoIs the "million token context window" available to anyone outside of a few enterprise customers? Will it be affordable? Gemini 1.5 still lags behind GPT-4 for most of my programming related questions. In fact, Claude-3 is a better competitor. I'm skeptical of Google - all of their "breakthroughs" seem to be unreleased research. Meanwhile, the rest of the world passes them by.
- swyx 3y agoi believe it is generally available in aistudio today, and jeff dean just rolled out limited api access yesterday. some folks in the latent space community alr reported getting access so i think its a pretty broad rollout. ive not read any reports on pricing which obviously would be the main constraint on using this thing
- loudmax 3y agoThe problem is that Google has been positioning itself as the leader in AI for over a decade, and now that powerful AI is starting to become a reality, Google seems completely blindsided. They have no idea how to capitalize on this development. Google's problem isn't lack of engineering talent, it's lack of leadership. If Google's board of directors gets their act together and finds new leadership, Google could yet harness what remains of their engineering talent and stay in the game, or even pull ahead. A lot of the pieces are there for Google to succeed. They still have top researchers and the institutional skill to run AI at scale. What they lack is clarity of vision. Under the current management, Google is following the paths of Xerox and Kodak.
- spiderice 3y agoIt's surprising to me that Sundar hasn't been fired after missing so badly on AI (along with a host of other misses in his tenure). Maybe it's coming, but I really don't see what the Google board sees in him.
- yellow_postit 3y agoSundar is to Google what Ballmer was to Microsoft. If the board wants to shift focus from high confidence near/medium term revenue they likely need a new leader.
- websap 3y agoSince Sundar became CEO in August 2015, Google's market cap went from ~350B to ~2T , why do you think he's an ineffective CEO? Thats 6x returns!
- glimshe 3y agoCheck the competitors - why didn't Google grow as fast as Microsoft or Nvidia? So yeah, that's ineffective. Maybe you could have grown Google as much as Sundar because he was essentially sitting on a gold mine found by the Google founders.
- barfbagginus 3y agoThey offered Gemini advanced for 20 bucks a month. But the performance there is maybe neck and neck with GPT 3.5. They don't offer the long token Gemini model to people paying money... They just expect you to Shell out 240 a year for a GPT 3.5 class model. It really feels like they're trying to sell to people who don't know how to evaluate llms, and they're not ready to offer anything out that competes with gpt4. At least not at the gpt4 price point. I feel that this indicates a leadership that either doesn't understand what it means to deliver value, or does not have a feasible opportunity to deliver value. It feels hey're BSing the market without knowing what they're doing.