4 ms·
"average Joe there is no difference from one product to the next" Yeah that's why OpenAI build an data center imo, the moat is on hardware software ??? even s
by tonyhart7 1y ago
"average Joe there is no difference from one product to the next"
Yeah that's why OpenAI build an data center imo, the moat is on hardware
software ??? even small chinnese firm would able to copy that, but 2 million gpu ???? its hard to copy that
- briansm 1y agoThe AI hardware requirements are currently insane; the models are doing with Megawatts of power and warehouses full of hardware what an average Joe does in 20 Watts and a 'bowl of noodles'.
- KineticLensman 1y agoThey handle many more requests per second than an average Joe
- otabdeveloper4 1y agoNot really. They have large contexts and lack of proper caching for "reasons".
- otabdeveloper4 1y agoSkill issue. You can easily get x10 optimizations with some obvious changes. You can run a small 100 person enterprise on a single 24 gb GPU right now. (And this is before economies of scale have started optimizing hardware.) OpenAI needs the keep the illusion of an anthropomorphic AGI chatbot going to keep the invenstments flowing. This is expensive and stupid. If you just want to solve the actual typical business problems ("check this picture for offensive content" and similar stuff) you don't need all that smoke and mirrors.