4 ms·
Looks like they are more focused on the economical aspect of those large models? Like 90~95% performance of other frontier models at 50%~70% price.
by summerlight 2y ago
Looks like they are more focused on the economical aspect of those large models? Like 90~95% performance of other frontier models at 50%~70% price.
- TIPSIO 2y agoI do like the trend. Imagine if Anthropic or someone eventually release a Claude 3.5 but at like a whopping 10x its current speed. Would be incredibly more useful and game changing than a slow o1 model that may or not be x percent smarter.
- sgt101 2y agoWe might see that with the inference ASICs later this year I guess?
- xendipity 2y agoOoh, what are these ASICs you're talking about? My understanding was that we'll see AMD/Nvidia gpus continue to be pushed and very competitive as well as have new system architectures like cerebras or grok. I haven't heard about new compute platforms framed as ASICs.
- Workaccount2 2y agoCerebras has ridiculously large LLM ASICs that can hit crazy speeds. You can try it with llama 8B and 70B: https://inference.cerebras.ai/ https://inference.cerebras.ai/ It's pretty fast, but my understanding is that it is still too expensive even accounting for the speed-up.
- throwup238 2y agoIs Cerebras an integrated circuit or more an integrated wafer? :-) And yeah their cost is ridiculous, on the order for high 6 to low 7 figures per wafer. The rack alone looks several times more expensive than the 8x NVIDIA pods [1] [1] https://web.archive.org/web/20230812020202/https://www.youtube.com/watch?v=pzyZpauU3Ig https://web.archive.org/web/20230812020202/https://www.youtu...
- campers 2y agohttps://www.etched.com/announcing-etched https://www.etched.com/announcing-etched I think there's another one but I can't remember the name of it. Also a bit further out is https://spectrum.ieee.org/superconducting-computer https://spectrum.ieee.org/superconducting-computer "Instead of the transistor, the basic element in superconducting logic is the Josephson-junction."
- bangaladore 2y agoSonnet 3.5 is fast for its quality. But yeah, it's nowhere near Google's flash models. But I assume that is largely just because its a much smaller model.
- Workaccount2 2y agoThey are going for large corporate customers. They are a brand name with deep pockets and a pretty risk-adverse model. So even if Gemini sucks, they'll still win over execs being pushed to make a decision.
- RhodesianHunter 2y agoThat doesn't seem like much of a plan given their trailing position in the cloud space and the fact that Microsoft and AWS both have their own offerings.
- resters 2y agoMaybe Google is holding back it's far superior, truly sentient AI until other companies have broken the ice. Not long ago there was a Google AI engineer who rage quit over Google's treatment of sentienet AI.
- hadlock 2y agoNot even trying to be snarky, but their lack of ability to offer products for more than a handful of years, does not lend google towards being chosen by large corporate customers. I know a guy who works in cloud sales and his government customers are PISSED they are sunsetting one of their PDF products and are being forced to migrate that process. The customer was expecting that to work for 10+ years and after a ~3 year onboarding process, they have 6 months to migrate. If my neck was on the line after buying the google PDF product, I wouldn't even short list them for an AI product.
- jsnell 2y agoWhat Google Cloud pdf product is that? I thought my knowledge of discontinued Google products was near-encyclopedic, but this is the first I've heard of that. But as an enterprise customer, if you expect X, don't you get X into the contract?