11 ms·
Google Invests Almost $400M in ChatGPT Rival Anthropic
- retskrad 4y agoLike Mike Tyson once wisely said, everyone has a plan until they get punched in the face.
- markdog12 4y agoHow is this not the top comment?
- xiphias2 4y agoThis is scary: Google was always proud of being on top of AI research. With so many engineers needing to outsource something so core to their mission means that their system is not as good as they want us to believe.
- chaoz_ 4y agoor it's just a good bet to maximize chances. It's not like they invested a large portion of their assets. edit: last sentence sounds kinda weird given recent layoffs round
- sockaddr 4y agoScary? It’s reassuring to me
- Traubenfuchs 4y agoIn German we have a saying: Everyone is cooking with water. Google has no secret sauce, just momentum, reputation and its position as old big tech leader.
- m00dy 4y agoa.k.a they have credit...and it is doomed to fail...
- moffkalast 4y agoWhile that's true, some can afford more water than others and finer spices.
- Zetobal 4y agoYeah, but there is a reason why in a restaurant setting most food sold is fast food. No, need for finer spices and more water you just need to hit that threshold.
- seydor 4y agothey have a lot of sauce (money) but it s not secret
- anothernewdude 4y agoThey made bloom, and do have an internal chat AI. They have always lacked focus however.
- Zetobal 4y agoUm... BLOOM was independently trained?
- ChuckNorris89 4y agoCan anyone please explain to me why does Google need to buy companies like Anthropic when they already have DeepMind and Google Brain? I thought they were Google's AI spearhead. To me it seems like Google isn't lacking internal ML talent, but more like it's lacking management, direction, vision and focus in the ML space. Buying more companies while staying fragmented and directionless won't necessarily give them a win.
- ur-whale 4y ago> Can anyone please explain Talent acquisition. Also : Deepmind is based in the UK and does whatever the F*CK they want inside Google instead of actually contributing to Google's bottom line.
- ChuckNorris89 4y ago>Deepmind is based in the UK DeepMind isn't UK exclusive. Ian Goodfellow works there as well from the Bay Area, AFAIK. >does whatever the F*CK they want inside Google instead of contributing to Google's bottom line And that seems like the bigger problem with Google, not the lack of proper talent, which I also raised in my argument. You can't successfully steer a ship when everyone runs amuck doing whatever they want. Making the ship larger won't fix this.
- astrange 4y ago> Also : Deepmind is based in the UK and does whatever the F*CK they want inside Google instead of actually contributing to Google's bottom line. Sure, but that's what everyone does at Google. They don't hire engineers to make money, they hire them because Brin and Page enjoy keeping engineers around like pets.
- ur-whale 4y ago> because Brin and Page enjoy keeping engineers around like pets. Funny, but inaccurate. First, Brin has stopped giving a damn about Google a very long time ago to go and enjoy his life. I suspect from around the time of the "China incident" where both he and Page realized that having ethical positions at the scale Google had reached back then was just not possible anymore. Second, Page held on for a while longer, but eventually followed Brin in not giving two f*cks any more and just enjoying their billions. Page then proceeded to pick the most milquetoast personality in his entourage as his successor (Sundar Pichai), probably because he thought he was the candidate most likely to inflict the least amount of damage with the mighty thing he was handing over (by doing nothing with it). No, I think the explanation is very simple: Google believes that acquiring top talent is the path to further success. They're correct but fail to see that it is only a tiny first step on a very long road. Namely: once you've got the talent, you must: a. Not spoil them rotten by throwing oodles of money at them b. Direct them towards worthy goals c. Focus on execution by actually *managing* them d. Not allow them to play the "hire me for 3M USD a year, I'm an AI diva" musical chair games and actually deliver tangible value. These days, Google is simply incapable of these four things.
- parker_mountain 4y agoWorth pointing out, but they took a huge round of funding from SBF prior to his arrest. Not sure what liability they have from the bankruptcy court, and the surrounding clownshow. >The Series B follows the company raising $124 million in a Series A round in 2021. The Series B round was led by Sam Bankman-Fried, CEO of FTX. The round also included participation from Caroline Ellison, Jim McClave, Nishad Singh, Jaan Tallinn, and the Center for Emerging Risk Research (CERR).
- SturgeonsLaw 4y agoGuess the Center for Emerging Risk Research failed to catch the risk that was emerging from their co-investors
- college_physics 4y agoYou are assuming they want to "catch the risk" but maybe they want to be the risk?
- astrange 4y agoThis fits the trend where they only care about risks that don't exist like AGI, because that's just so much more interesting than the ones that do exist.
- rvnx 4y agoJust a general reminder (non-specific to this situation, but it can explain many moves): Sometimes funds don't invest because of the product or the company, sometimes it's just to take over another investor's position (or make the other investor's position look better). When things go really wrong, the ultimate solution is to use the company that has had a successful exit to buy a failing company.
- kenneth 4y agoSo then perhaps the equity in Anthropic will be owned by the FTX creditors through bankruptcy and will appreciate greatly to the point where it could repay all the creditors. That would be hilarious. For what it's worth, when MtGox blew up, it took years to recover and distribute what Bitcoins were left. Everyone was frozen out, but when they finally got their money back it was worth far more than when MtGox blew up. I have friends who are sitting on millions thanks to this. They probably would have sold on the way up or during one of the crashes. But thanks to the illiquidity during bankruptcy, they're far better off now.
- MichaelRazum 4y agoIt feels a bit like a Kodak moment. Fore sure google can replicate chatgpt. But there is no business model behind it yet. Bing on the other hand just don't care that much and is willing to integrate it to get more traffic.
- Xaiph_Rahci 4y ago> there is no business model behind it Why can't Google use the user's prompt (and AI's output) to display targeted Ads?
- MichaelRazum 4y agoThe question is how much worth is it? Looks like a complete different Ads model, compared to google search, with multiple results and the payed ones on top.
- marginalia_nu 4y agoThey can, but if their competition isn't doing the same, their offering is strictly worse. I'd guess given the amount of self-cannibalization Google has been doing the last few years, the fervor with which they've been sticking ads everywhere even to the clear detriment of utility suggests they're struggling to present black numbers through growth. Having to operate at conversational AI service which is competing with their own main offering, at a loss, to run a competitor out of business is not what they want to do. Not with bearish investors, and especially not given the regulatory scrutiny they're under.
- visarga 4y agoI think the Google era ended in Nov 2022 when chatGPT was launched. They had a good quarter century run. Keyword search on top of ads, spam and disinformation is not a good product anymore, and won't cut it after people's expectations moved up. They can't even faithfully follow a search term, and instead return exactly what you wanted to avoid. Try finding "the shortest time for crossing the English Channel entirely on foot", it will tell you all about swimming, boats, even hovercrafts, ferries, but not about an immigrant trying to walk the tunnel.
- arnaudsm 4y agoI wonder what happened at Google. They basically invented Transformers, and had useful LLMs for a while. Bert, Lambda, Palm, Sparrow were all cutting edge. Why didn't they ship something like ChatGPT earlier? Lack of product vision? Perfectionism? Is this Xerox vs Apple all over again ?
- k__ 4y agoMaybe they thought they could do better than just "building a bigger model".
- michaellee8 4y agoThey do have lamda and it is available for test in their AI test kitchen. Seems much better handling of sensetive and offensive content then ChatGPT for me, but still cannot perform basic addition like ChatGPT does. I think it is technically better than ChatGPT but maybe they are only going to release the perfect product. Tbf ChatGPT was far from production quality for serious applications, lots of misinformation and you can make it produce very offensive content. It is a good for toying around but you cannot take the output seriously.
- visarga 4y agoI think a token effort to avoid offensive content is ok, but chatGPT should quickly detect if the human wants to go outside the box and allow it. If a human pushes it means they understand the risks and take full responsibility for the outcome.
- rvnx 4y agoThis is not how Google's AI Test Kitchen is designed. AI Test Kitchen seems quite boring and very framed system, where you can ask what is the best Dyson model for example, or the old-style "GPT dungeon game", it doesn't really go off-rail (this is part of the product specifications sadly :/).
- LoganDark 4y ago> chatGPT should quickly detect if the human wants to go outside the box and allow it This is why "jailbreaking" is a thing. Once you convince the model that it's OK, it'll let you do anything from then on. -Emily
- kolinko 4y agoWhich is interesting, because Google claims that their language model is even better than ChatGPT...
- 0XYZxyzXYZ0 4y agoThe people who got access to Lambda recently beg to differ.
- qwertox 4y agoNow I'm really confused. I asked ChatGPT --- 1) How does LaMDA compare to GPT-3? "LaMDA and GPT-3 are both language models developed by OpenAI, but they have different focuses and capabilities. [...]" --- 2) Why is it referred to as "Google LaMDA" if it is an OpenAI technology? "It may be referred to as "Google LaMDA" due to confusion or incorrect information, as LaMDA is a technology developed and owned by OpenAI, not Google. [...]"
- 0XYZxyzXYZ0 4y agoAnd now we shall ask Lamda for comparison.
- endisneigh 4y agoGreat example of why chat gpt is nothing to worry about. https://blog.google/technology/ai/lamda/amp/ https://blog.google/technology/ai/lamda/amp/ Without provenance GPT is only useful for things where you don’t care about correctness, or one’s where you already know or can find the answer.
- prmph 4y agoWhy doesn't ChatGPT always just annotate its responses with references? maybe ranked in other of perceived reliability. That would make it answers more useful. Probably an idea for an app based on ChatGPT.
- 4y ago
- Havoc 4y agoThat's quite surprising given that the prevailing opinion seemed to be that they already have comparable tech in-house. Although at google scale it might make sense to eliminate competitors via acquisition
- londons_explore 4y agoGoogles in-house tech they haven't managed to get to pass the threshold for release into a product. By investing in a competitor, they at least indirectly get their foot in the door of someone who releases to the public, even if the product quality is worse and the quality-bar for release is lower.
- sorenjan 4y agoI've heard that Google have models at least as good as the competition, but they're not using them in production because of scale. Don't know if it's true, but it sounds reasonable. Running inference that uses a lot of compute might be too expensive when you have billions of search requests and make a fraction of a cent on each, or whatever the actual numbers are. If that's the case they're not working towards a "better" model, they're probably more concerned with a cheaper one. And maybe something where you can make sure to construct the answer using their knowledge graph instead of hoping the black box doesn't just give plausible sounding replies that are wrong.
- visarga 4y agoGoogle never released a state of the art model, what they run in translate, ranking, etc are efficient models on par with state of the art a few years ago. They train huge models that are too large to even demo (PaLM 540B) and never release the models, not even for academia to try to build on them. Their voices and OCR are behind competition, I'd rather use ElevenLabs and Amazon Textract. Google makes a lot of noise but delivers little, and what they deliver is almost never the best in the world. I think maybe they made a mistake with TPUs and the PyTorch-NVIDIA path seems to be more productive and can deploy more advanced LLMs. There was a time when I was dying for an invite to Gmail or Google Wave, but that time has long passed and nothing in-between caused that level of excitement. What I appreciate most from Google is YouTube, and not for the UI or recommendations but for simply being the largest video platform with everything you could want in music and education. If I lost access to YouTube internet would be dead for me, well, almost dead.
- hackernewds 4y agoGoogle does produce world-class products that are virtually free (and wouldn't be through competitors). They say, the best products run so well you barely even notice their competitors or their complexity. Google Maps comes to mind.
- astrange 4y agoGoogle Maps has actually gotten worse over time, and not even in the same way Search has where spam has been winning. eg in Japan they used to license the very best map data, but switched to the 2nd-best and cheaper one also used by Apple, and do a worse job presenting it. And of course globally its color scheme and visual hierarchy are stuck in 2005.
- 0XYZxyzXYZ0 4y agoMy question would be: What is the purpose of all the Product Managers and Group PMs at GoogleAI?
- bsenftner 4y agoFiefdom. Every PM is a little Barron of a small kingdom, and they must grow...
- 0XYZxyzXYZ0 4y agoAfter so many years, Google should know by now, this is not the 'right' way of doing/managing things. This just pushes the coasting 'theory' even harder.
- mkl95 4y ago> Google and Anthropic declined to comment on the investment, but separately announced a partnership in which Anthropic will use Google’s cloud computing services. I really hope they have tested some prototype extensively before signing the deal. Running this kind of stuff on GCP could be a massive clusterfuck.
- yunohn 4y agoI assume it means they will spend money on GCP for running/hosting things. Are you thinking they’ll let it free and train a chatGPT on GCP activity/log data or something? What would be the point of that?
- mkl95 4y agoI read enough horror stories about GCP in the last few years to prefer AWS over GCP with some exceptions (mostly GKE). What I'm saying is I hope they don't expect the same level of service from GCP that they expect from something like AWS, regardless of what they are using it for.
- mark_l_watson 4y agoWhy would startups requiring a ton of GPU compute use AWS or GCP, unless they received extraordinary discounts? I have never used them, but I once did a price comparison with AWS and Lambda Labs, and it didn’t look good for AWS. There must be many smaller providers that offer better rates, or self-host.
- deleted 4y ago[deleted]
- mkl95 4y agoI don't work with GPU based stuff, but I work with some convoluted lambda based systems that are kinda expensive. You could literally replace all of them with a $5/month VPS (several orders of magnitude cheaper), or an equivalent Lightsail instance. You would go with Lightsail if you care about some SLA.
- LunarAurora 4y agoI think the "Anthropic Partners with Google Cloud" [1] title is more appropriate Also this quote is interesting [2] Anthropic was formed in 2021 when a group of researchers led by Dario Amodei left OpenAI after a disagreement over the company’s direction. They were concerned that Microsoft’s first investment in OpenAI would set it on a more commercial path and detract from its original focus on the safety of advanced AI. [1] https://www.anthropic.com/news/announcement https://www.anthropic.com/news/announcement [2] https://archive.ph/ciZPV https://archive.ph/ciZPV
- iamgopal 4y agoGoogle seems to forget simple thing, what google used to do great and not much now, is only one thing. Fast Software. When in doubt choose fast. When not in doubt, choose fast.
- asim 4y agoIt's interesting to read the comments and then look at Slack vs Microsoft Teams. Slack was the clear leader in at-work group messaging, people thought it was a run away success and then Teams basically obliterated it. Google has huge scale distribution on all levels. When the time comes they'll put out the right product and it will scale to millions upon millions of users within a very short time span. The quality of the experience will also be vastly superior. Google's at a stage where they're not about making speculative moves or putting out half baked products because it's just not worth it. That's the nature of big companies with a brand, reputation and scale. Look at Apple, you're not seeing terrible product launches, they take their time and do it right. Honestly, I don't think this is a one horse market, many players will be in the game, just like other markets. They don't need to be #1 and probably won't be, but it will be a quality product that either drives a new search format or a revenue stream for other things e.g plugs into services you already use, increases usage, adoption and costs. Could they acquire an OpenAI competitor, maybe, but anti-trust is a pretty big problem right now. It's most likely that we're just going the route of everyone copying the form factor and whoever has the best experience/data and speed of response wins.
- Oras 4y agoGoogle made lots of half baked products before and terminated them when they didn't work as expected (https://killedbygoogle.com/ https://killedbygoogle.com/). I agree with some of your points regarding scalability and add the fact that Transformer architecture (which GPT-3 was trained on) was created at Google. They also have all the data in the world to train a better model. Interesting to see what Google will come up with.
- bilbo0s 4y agoGoogle made lots of half baked products before and terminated them when they didn't work And how many of those new products cannibalized their current cash cow? Let's not act like ChatGPT is not a completely different sort of threat than game streaming on Stadia or some dumb product like that.
- 4y ago
- wslh 4y agoUnwalled: https://archive.is/zR74V https://archive.is/zR74V
- peakminute 4y ago[dead]
- deleted 4y ago[deleted]
- alberth 4y agoGoogle Brain? Hasn’t there existed an entire department for 10+ years called Google Brain that should have been working on creating their own “ChatGPT”? Is this a failure due to how Google has structured their initiatives/promotion review process?
- peanuty1 4y agoGoogle already has a ChatGPT competitor called LaMDA (https://blog.google/technology/ai/lamda/ https://blog.google/technology/ai/lamda/), they just haven't released it to the public (or to the research community for that matter). Probably because it would cannibalize their revenue from Google search (Innovator's Dilemma).
- alberth 4y agoInteresting list of investors: - Eric Schmidt (former Google CEO/Chairman), Series A - Sam Bankman-Fried, lead investor in Series B - Caroline Ellison, Series B https://www.crunchbase.com/organization/anthropic/company_financials https://www.crunchbase.com/organization/anthropic/company_fi...
- Laaas 4y agoI wonder whether the courts will claw the invested money back.
- troydavis 4y agoAssuming that the investment was made by one of the entities that filed for bankruptcy protection (which seems likely based on filings), bankruptcy trustees generally attempt to sell the equity that the company purchased. In general, that’s because the the clawback period is short: 90 days before filing unless the transaction was between insiders (which no one has alleged of the Anthropic investment). In this specific case, the equity has probqbly appreciated. OpenAI is Anthropic’s closest comparable and its valuation went through the roof. Even after allowing for transaction costs, FTX trustees will probably get more for the equity than it cost. So, the question is likely this: who will buy a ~10% stake in Anthropic?
- sirsinsalot 4y agoThe circle jerk goes on
- mfDjB 4y agoGoogle is slow in the AI space because it isn't willing to take the risks its competitors are willing to take due to PR and branding factors. Anthropic with its focus on AI safety is the wrong choice here, it will slow them down not speed them up.
- thomassmith65 4y agoI get that GPT3 is a miracle of miracles – that it's even better and even more promising than 'Singularity studies', Soylent, HTML5, Bitcoin, autonomous vehicles, NFTs and Web2.0... /s ...Google has already "improved" its search with AI. More and more AI "improvement" each year for the past decade. I can imagine what further Google AI "improvements" will look like as it frantically chases ChatGPT (which time might well show is a smaller search niche than plain-text search) If I were in charge of Google, I'd dumb search down again - dumb it down to the point that it provides useful results.
- bpodgursky 4y ago> dumb it down to the point that it provides useful results I don't think you understand the extent to which search results have been broken by an arms race of SEO and spammers. Contemporary Google search would be incredible on the internet of 2005, but it's operating in an adversarial environment (and Google in practice has to restrain itself for antitrust concerns).
- prmph 4y agoNope, Google search is bad, not because of SEO spammers, but because it prioritizes results that make money for Google, not what you're actually seeking. And for what it's worth, I think AI generated search results will actually be more resistant to spamming, since it can more deeply understand content to determine whether is it spam or not, in the same way email spam is mostly a solved problem. Of course, if entities like OpenAI become "evil", then it is a simple matter for them to render the search less useful, in the pursuit of profits.
- Jensson 4y agoI've worked at Google search, I don't think you understand what a huge cumbersome mess that codebase is, many of the complaints people have about it are probably bugs where some modifier isn't properly taken into account in some sections of it. And I never heard anyone talk about sending people to more valuable sites. Google makes most of their money from search, not on third party ads they might monetize on whatever site you get to, if even a tiny fraction stop using search due to dissatisfactory search results then that is a net loss. So from what I know the issue is scope creep and technical depth for sure. Also there isn't really one search team with one search algorithm, different kinds of searches has different people, so whatever you search for might have someone who isn't good at their job. But, to go with the greed reason you are looking for, I'd bet that if people start seeing bad results for search queries that are moneyizable they would quickly replace the person responsible for it and fix it. On the other hand, low value searches from people who aren't looking to buy anything probably costs more for them to run than they get back in ad revenue, I wouldn't be surprised if nobody at Google would notice if those got worse. In addition, since Google mostly uses internal tools with internal help pages and internal version of stack overflow their programmers wouldn't notice that it got worse either, and things that neither programmers nor money cares about wont get fixed. Lastly, I quit Google years ago and have no stocks or friends left there, I don't care about them. I just wanted to clarify a few things. Also there are a lot of money grubbers at Google, but I mostly saw that in the ads organisation, search and ads are very separated though, ads doesn't have power over search since most ad money comes from search and search is the founders darling. So when things are broken its more likely to be incompetence or bloat or something like that than evil. At least for now, will change in the future as culture there normalizes to the rest of Google/rest of companies.
- mark_l_watson 4y agoInteresting interview with the sister and brother founders of Anthropic on the Future of Life Institute Podcast (also on YouTube). They were talking about developing safe, steerable, and explainable AI. I hope they continue to live up to their good intentions (no reason to doubt that they will try). As much as I enjoy using OpenAI’s (and Hugging Face’s) models and infrastructure, I also like to see lots of competition. Cory Doctorow recently wrote [1] how social platforms start out by giving a lot of value to users, then short change users to give value to advertisers, and finally short change advertisers to take huge profits for themselves. I wonder if the large language model businesses will see a similar trajectory. [1] https://pluralistic.net/2023/01/21/potemkin-ai/ https://pluralistic.net/2023/01/21/potemkin-ai/
- aww_dang 4y agoGoogle Search Quality Team: "Don't use AI generated content. We will penalize or nuke your sites." Also Google: "We need to enhance search with AI generated content"
- meltyness 4y agoFAANG+M are all machines of oppression, now. They are the cause of a less free press, a less free software ecosystem, and especially financial oppression which they are most successful at - as enabled by decades of loose monetary policy and buybacks in dire need of regulatory controls. A brief look at the economic circumstances of the "haves" and the physical circumstances of the have-nots across the West coast under the hard labor of the SF Fed will make this abundantly clear to basically anyone. It's a place where every cause is an unbearable burden and simultaneously the only hope in perpetuity until hush gifts and roadblocks rain down from Capital wherever. Further, their expenditures are why you've heard that Elon Musk is a "robber baron" when in reality it is these companies that are only investing in their own funny money while the quality of their products dwindle, and often fall catastrophically as they compete and muscle out the old guard rather than cooperating and improving things. Or even better collude and calcify investment in places where growth is truly needed, like the telecoma.
- Pigalowda 4y agoMicrosoft beat them to it. Soon we’ll have an explain bar with Clippy on edge. I think I’d use edge and maybe even bing if they just put gpt on there to mess around with. Google, late to the game, will have anthropic which will be killed off/extinct within a few years anyways. The name may reference the anthropic principle but I’m going with a rewording to “Anthropic extinction”
- pharmakom 4y agoI’m honestly surprised. Google can replicate this research and even push it forward. Is this simply because Microsoft is all in on Open AI?
- skrowl 4y agoIs it as politically biased as ChatGPT?
- damita111 4y ago[dead]