6 ms·
I think maybe you don't understand that they don't have enough GPUs to do this, and money can't buy enough GPUs to do it.
by mortehu 3y ago
I think maybe you don't understand that they don't have enough GPUs to do this, and money can't buy enough GPUs to do it.
- cuuupid 3y agoThis may be true but isn’t their official stance that their models are too powerful and could destroy Western civilization as we know it?
- deleted 3y ago[deleted]
- chrisshroba 3y agoNot disagreeing but just curious, why can't money buy enough GPU's? OpenAI's prices seem low enough that they could reasonably charge 2x or more to companies eager to get on the best models now.
- jerrygenser 3y agoI think GPUs are in short supply and Nvidia can't make enough to keep up with demand.
- jiggawatts 3y agoThey're giving people access to GPT-4 via Bing for free, but apparently can't accommodate paying API users!? That makes no sense. What makes much more sense -- especially if you listen to his interviews -- is that Sam Altman doesn't think you can be trusted with the power of GPT-4 via an API unless it has first been aligned to death.
- 90d 3y ago"Free". The worst four-letter F word in America.
- cptaj 3y agoMicrosoft is giving that for free but I assume they're paying OpenAI for it. And having such a big anchor tenant, its reasonable that you would prioritize them if GPUs are in short supply.
- selcuka 3y ago> Microsoft is giving that for free but I assume they're paying OpenAI for it. Yeah, but Microsoft already gets 75% of the profits OpenAI makes, it's not the same price for them as the rest of us.
- ec109685 3y agoIt’s the exactly the same. If they could make 75 cents selling the compute to someone else for $1 versus not making it providing the Bing chat service, that is 75 cents they lose.
- selcuka 3y agoWhy do you assume that the same amount of computing power would be used by someone else? There are only so many customers. You can't magically start selling more compute if you stop using it yourself.
- ec109685 3y agoAt scale, GPU's are capacity constrained right now, so if Microsoft stopped using them, their capacity would be absorbed by others.
- itissid 3y ago10 billion$
- flangola7 3y agoBing GPT-4 is a much smaller and less capable model than regular GPT-4.
- ben_w 3y agoTo a first approximation, the increased share price of NVIDIA is because AI developers including OpenAI bought as many as NVIDIA can make.
- flangola7 3y agoThis is the bottleneck. EUV Photolithography is one of the hardest engineering challenges ever faced, it's like trying to drop a feather from space and guaranteeing it lands on a specific blade of grass. Manufacturing these GPUs at all requires us to stretch the limit of what is physically possible in multiple domains, much less producing them at scale.
- xtracto 3y agoThanks for this explanation! :) (as someone without knowledge of the hardware process I appreciated it). It is SO amazing that we have such a driving force (LLMs/consumer-AI) for this (instead of stupid cryptocurrencies mining or high-performance gaming). This should drive innovation pretty strongly and I am sure the next "leap" in this regard (processing hardware) will put technology in a completely different level.
- fatherzine 3y agoThat's a cool last minute detour from techno gods. We can incentivize AI to work on crypto mining, and regain our fully engaged primeval lives back ;)