7 ms·
Big Tech groups say their $100B AI spending spree is just beginning
- karimf 2y agohttps://archive.is/gs1xT https://archive.is/gs1xT
- goethes_kind 2y agoHere's a question since everyone keeps bringing up the DotCom bubble. Although the bubble burst, have not the people who were building in the 1999, still more than made up for their losses by having the know-how and being able to capitalize on the subsequent emergence of the WWW as we know it today?
- TMWNN 2y agoSimilarly, I just saw it pointed out that the dotcom bubble was solely in the stock market. Internet traffic kept rising the whole time and beyond.
- delfinom 2y agoA bubble doesn't mean the underlying demand/industry doesn't exist. It means there's a mass over investment and over spend in companies trying to serve the demand at the time.
- Ekaros 2y agoAnd that current valuation of the underlying market is x times the real valuation. And real valuation can be significantly non-zero. Take housing market. Most of the houses do have some real value. And even if the bubble pops, it doesn't take their values to zero, it might be momentarily be just below real value.
- lallysingh 2y agoI look at it as investor error due to lack of expertise in the business area. If investors understood the economics of internet businesses better (and almost nobody did in something this new) they may have helped grow the Internet economy even faster than it did, without the bubble or burst.
- madaxe_again 2y agoLikewise. And I look at the current situation and also see investor error, but in the opposite direction, as a great many investors equate LLMs to AI/ML, and vastly underestimate the space in which this technology will disrupt. I keep reading pieces in Forbes and similar which are like “does the world really need a better chatbot?” or “can Google justify spending $10bn on making a better cat picture?”
- gradus_ad 2y agoOutside of LLM's, which AI/ML product has the potential for widespread consumer adoption? I recognize the usefulness of modern AI in all sorts of domains, but they are almost entirely niche services for business and not targeted to the broad consumer. The problem then is not that AI is not cool or useful, just that it won't make as much money as the enthusiasts think, at least not now.
- madaxe_again 2y agoThose “niche services” are potentially much more lucrative than consumer-facing products. For instance, an ML quant could be a license to print money, and would have appropriate costs. Designing more efficient (cheaper) structures and machines doing FEA/CFD better than current algorithmic models would be a huge boon to engineering industries. Sentiment analysis and forecasting for government. Military strategy that outsmarts any human strategist. Demand lead pricing for products and services. JIT manufacturing management through superior cost and demand forecasting. Identification of baroque tax fraud. Diagnosis of medical conditions. Product recommendations. Tailored drugs. Pre-crime. On it goes. These are just a few examples of where ML is already beginning to be applied and reaping rewards.
- jltsiren 2y agoI think the bubble was more about the lack of viable business models. The technology was real and the investors saw it, but the business models needed another decade to mature. The same could happen again. It may be easier to find good uses for AI than to make large amounts of money with it.
- aurareturn 2y agoFollow up question: Where in the dotcom bubble is AI in 2024? Is it already 2000? Or is it in the beginning, 1995? 1998? For some context, if you invested in Nasdaq in Jan of 1995 and did not sell until September 2001, you'd still be up by 86%. And if you invested at the absolute peak of the bubble, you'd still be up 250% in 2024.
- throw_pm23 2y agoYou would not be up 250% if the companies you invested in went bankrupt. Perhaps if you invested in Amazon or MS.
- Etheryte 2y agoThe parent comment clearly states they're talking about investing in the Nasdaq.
- Integrity 2y agoIf most AI businesses are actually API business that call ChatGPT, and people learn that, the hype will start declining.
- aurareturn 2y agoI disagree. Meta, Anthropic, Google, Mixtral have demonstrated that OpenAI can be caught and matched. Today, if you have a powerful enough GPU cluster, you can run an internal GPT4-level LLM by deploying Meta's LLama 3.1 405b. If OpenAI's GPT5 is as big of a leap as GPT3 to GPT4, the hype will reach unprecedented level again in my opinion.
- _heimdall 2y ago> Today, if you have a powerful enough GPU cluster, you can run an internal GPT4-level LLM by deploying Meta's LLama 3.1 405b. You also have to be willing to consume ungodly amounts of energy to run those GPUs. That seems like an important caveat while the conversation about climate change and unpredictable weather is still top of mind for so many people.
- DebtDeflation 2y agoGates Law variant: "People always overestimate the impact of a new technology in a year and underestimate its impact in ten years." In 1999 people predicted that the Internet would change everything, in 2000 people called the Internet a flop and made fun of pets.com sock puppets, by 2010 the Internet had in fact changed everything.
- Gigachad 2y agoWe are more than 10 years in to crypto, and if it all vanished tomorrow, I can’t imagine anything changing other than a few indexes invested in it crashing. And less ransomware I guess.
- bitnasty 2y agoNot sure the comparison is justified. Sure, AI is cool, hot tech, but the internet enables connection between virtually every single human alive. Completely different scale of influence.
- Barrin92 2y agoYou can shoot yourself in the foot and claim you became a better marksman in the process, that doesn't really do much to justify it though. All other things being equal they'd been better off investing their money or time into something that wasn't a bubble economy. This is basically broken window logic.
- jillesvangurp 2y agoVery different things. I lived through the dot com bubble (didn't get rich because I was busy doing a PhD instead). Basically, a massive amount of clueless idiots funding companies that were literally nothing more than a crappy website. It was over in a few years. At the peak of the hype, disgusting amounts of money got spent on companies that went absolutely nowhere because there was absolutely nothing there. And then it all fizzled out. But there was also a healthy amount of experimentation and new stuff happening. This feels different; there's actually some substance to the madness. Quite a few of the companies being funded are actually creating some pretty cool tech. And there's some real revenue potential as well; it's not just investment money keeping everything going. A good dot com era company reference would be companies like Google or Amazon that took the cash and got a lot of that tech making money for them even after the investment bubble burst. They also grabbed some of the smarter people at the same time. There are a few more examples. If you squint a little, you can see a few companies that are likely to be able to start raking in lots of cash soon that are at this point well funded. Also a lot of the current investment money is being converted into GPU hardware. Which is of course nice for companies like NVidia, whom are probably a bit over valued currently. But the point is that hardware is tangible. Even if the companies that buy it go bust, the hardware just ends up in the hands of others. We're talking many millions of GPUs that are being deployed and that, like it or not, will be doing a lot of AI workloads for years to come for whomever ends up owning it. And there are a lot of smart people trying to make that hardware do all sorts of cool stuff. Hardware is a much better asset to have than useless websites. And I don't think a lot of the software is that bad either.
- choppaface 2y agoAdd that in the dotcom bubble, internet-flavored growth had never happened before, so it was relatively harder to predict the growth of (say) Google. But today, deep-learning-flavored growth is a 10-year-old concept, and LLMs largely have leverage over existing (versus quite new) business models. There will probably be fewer new monopolies versus the dotcom era; in particular OpenAI has lots of competition.
- mu53 2y agoI think a likely and hidden contributor to the BigTech layoffs of 2023 is the development of AI. I know there are other reasons, but it didn't hurt that they had labor saving AI systems built that could handle the load. After hiring a lot of people, having systems built, and training data developed, they could replace large amounts of staff that used to need to do manual work those AI systems. Less manual moderation, more automated responses. It became "fashionable" to cut staffing levels, so companies followed suit. Most tech leaders avoid talking about how much labor AI will replace. We don't know yet, but it likely follow trends of making junior roles harder to find while making seniors more valuable with a slight reduction in the overall workforce. This has been present in all industries
- aurareturn 2y agoI don't think the layoffs were related to big tech firms wanting to replace the workers with AI. I think it is: 1. Over hiring from covid 2. A switch from developing traditional software to one that is LLM based
- impossiblefork 2y agoNah. It's much more likely to be the interest rates. The interest rates mean that the now gets a higher priority, and software ready in 2030 or later a lower priority.
- aurareturn 2y ago"Covid" implied both the stay at home digital boom and low interest rates.
- impossiblefork 2y agoBut the interest rates were low already after 2008.
- Etheryte 2y agoI don't agree with this take, the layoffs are companies simply returning to their regular baseline numbers. AI was just a comfortable scapegoat for many to put the blame on rather than "we like money".
- aurareturn 2y agoI can see hype go through the roof again if someone like OpenAI delivers a model that is as big of a leap as GPT3 to GPT4. Other LLMs have caught up to GPT4, but surely OpenAI has been using the 2 year lead they had and readying GPT5? There are two AI developments that I'm quite excited for: 1. Very large foundational models (such as GPT5-level LLMs) 2. Optimizations for smaller models, context size, inference speed, and multimodal LLMs I think 2024 has been the year for #2, which is why the hype has died down a little. No splash big models that shock the world and make white collar workers shiver. But #2 is crucial to actually deploying LLMs to the masses.
- helloworld42024 2y agoThis is spot on.
- nuz 2y ago~3 years since gpt-4 was finished training in 2021
- throw310822 2y agoGPT-4 was released in March 2023, one and a half years ago (I point that out because it feels like a different era). Not sure when they finished training it but I'm pretty sure it has nothing to do with (and it's in fact much later than) the training data cutoff, which was in September 2021.
- undbfhd 2y ago> There are two AI developments that I'm quite excited for What about these things excite you? Just the tech hubris of growth at all costs or the hope of some use case that has yet to manifest? > 1. Very large foundational models (such as GPT5-level LLMs) Has work been announced on or a release date been set for a GPT5 or are you just excited it might happen? Why stop there? Go ahead, be excited about MilleniumGPT. Is there evidence that bigger is better forever? > 2. Optimizations for smaller models, context size, inference speed, and multimodal LLMs To do what exactly? Write fan letters to olympians for me? Replace all of the real human friendships in my life? To write an annoyingly verbose email from a bullet list that the recipient will be loathe to read and so will feed it into another agent to turn the email back into the same bullet list?
- JonChesterfield 2y ago(even if you know LLMs are the future, please try to...) Take the pessimistic view on LLMs for a moment. That this doesn't really work out and the expensive computers are a somewhat embarrassing misstep. In that world, at least a few companies will find themselves with multibillion dollar high performance computers running on site. With capex and power numbers to scare the accountants and financial analysts. Not running LLMs. That's a really fast computer. Computers can do stuff. If not LLMs, it's going to do other things. To confidently sit out this capability acquisition round you need to be sure that LLMs are grossly overrated and also that all the competition will fail to find anything else to do with their GPU supercomputers. Oh, and that your own staff would also fail to find anything (else) useful to do with one. I am completely comfortable expecting datacenter scale supercomputers with previously unimaginable compute to do interesting things. I wouldn't want to be the megacorp missing the revolution because I spent the money on dividends instead.
- madaxe_again 2y agoLLMs are a subset of AI/ML. They are not the totality of the sphere, nor are they what is being worked on exclusively.
- justincormack 2y agoThe price of these computers is high now, due to supply constraints, so buying now isnt necessarily the best time for this outcome. You can buy some later... The things these can do is (a) memory bandwidth, Nvidia GPUs have been described as "the worlds most expensive memory controller". Generally very useful anywhere. (b) fast low precision floating point. Historically most of the uses of supercomputers wanted high precision, eg for physics etc but people are now experimenting with using lower precision given availability (c) fast networking. generally useful. We were seeing a spread of GPU into other applications pre AI, like GPU driven databases, I think this stopped a bit just because of pricing and availability.
- JonChesterfield 2y agoLots of memory bandwidth, low latency high bandwidth connections between nodes, lots of floating point. The MI300 looking a bit like HPC being repurposed for AI is probably a win in terms of using the hardware for other things in the future. I've had to double check the low precision point qualifier. I expected MI300X to run f32 and f64 at the same speed (and it does) and nvidia to have slower f64 (which it does). It looks like H100 is 250TF at half, 60TF at float, 30TF at double. MI300X is 650TF at half, 80TF at float or double. Very fast F16 indeed. (sourced from https://www.techpowerup.com/gpu-specs/radeon-instinct-mi300x.c4179 https://www.techpowerup.com/gpu-specs/radeon-instinct-mi300x... and https://www.techpowerup.com/gpu-specs/h100-sxm5-96-gb.c3974 https://www.techpowerup.com/gpu-specs/h100-sxm5-96-gb.c3974, I might have the wrong SKUs for comparison)
- blueflow 2y agoWhat do i need to say or promote to get some of these billions?
- fredgrott 2y agoHere is how to think about AI.... 1. No one would say the eye is conscious and yet its pattern matching is being re-used 2. The ML in the human brain re-uses the eye-cell wiring to pattern match....yes their was even a post either Friday or Sat here about that... If we then re-tool the under-pining of AI, i.e. ML to match the new discovery we still get not AI but a new ML tool... Or in short words find a fund index that is betting against the AI hype as the explosion will be massive.