4 ms·
I'm so tired of all this vertical integration. Can't we have hardware companies that make hardware, software (AI) companies that make software, and data compan
by amelius 3y ago
I'm so tired of all this vertical integration.
Can't we have hardware companies that make hardware, software (AI) companies that make software, and data companies (or government institutions) that run the software on the hardware and deal with our data?
- icapybara 3y agoWe do have those. It sounds more like you're saying that we shouldn't have vertically integrated companies.
- amelius 3y agoThe vertical integration allows them to corner the market and destroy the competition or prevent them from entering the market, which is bad for the consumer and bad for society, eventually.
- rootusrootus 3y agoIf we're making bets on OpenAI vs Nvidia in the hardware space, I know who I'm picking.
- icapybara 3y agoThat's a broad claim, you have to prove your case. You're asking for a ban on vertical integration as a business strategy.
- notaustinpowers 3y agoVertical integration is already under scrutiny by the antitrust folks. Even more so now after everything Google was able to get away with. OpenAI wanting to vertically merge to make their own AI chips may seem harmless enough (it's a good business move, we can cut expenses)! But we can't forget that Sam Altman just a few months ago told Congress he supports making an organization that companies need permission from to being creating/utilizing advanced AI systems. And he's such a kind man he's willing to lead that organization himself. Obviously someone integrating the chips to train AI, and having the ability to approve/deny his own competition is a huge red flag.
- stale2002 3y agoWell kind of. You are ignoring the elephant in the GPU hardware room right now, which is NVidia. NVidia has a near monopoly on the AI hardware market right now, so some vertical integration of alternative AI hardware doesn't seem nearly as big if a deal if it is needed to fight that current monopoly.
- notaustinpowers 3y agoThat's true, but again, him attempting to put himself as the gatekeeper of who can and cannot train/utilize advanced AI systems at scale gives him (almost) unilateral control over Nvidia's own AI chip manufacturing business. Deny startups the ability to train AI systems, and you deny Nvidia the opportunity to sell them their chips. Nvidia loses that revenue stream and stops producing AI chips due to high production costs and "lack" of demand. Ultimately leading to a market where only the obscenely wealthy companies who can manufacturer their own in-house chips can train AI, and even then, Sam Altman can deny even that.
- feoren 3y agoIt's lack of anti-trust laws and (more importantly) enforcement that allow companies to corner the market. nVidia and ARM should be worried about competition from OpenAI and Google: that's the good kind of competition that we want. If only "hardware companies" are legally allowed to make hardware, that increases their moat, not decreases it. Let's instead go back to when we actually enforced the anti-trust laws that we have. That was nice.
- ysavir 3y agoWould OpenAI be competing with them, though? If they just manufacture their own and use their own, but don't sell them, then nVidia and ARM are just losing a client, not getting competition. Ideally what we would see is OpenAI investing in a new but independently operated chip manufacturer that makes chips to their standards. Though is it also possible that a chip of such standard would be so specialized that it wouldn't be usable by others? I'm not a hardware person, so that's a genuine question.
- JumpCrisscross 3y ago> If they just manufacture their own and use their own, but don't sell them, then nVidia and ARM are just losing a client, not getting competition. That's competition. Apple Silicon completes with Intel at an ecosystem level.
- ysavir 3y agoI'm very hesitant to define competition as "can't sell to them because they make theirs in house". Losing a sale isn't competition. Competition is someone threatening to take your clientele from you with their own offering. Apple can afford to design and use its own chips, but they're in a pretty unique position to do so. It's not like every other consumer of their chips is going to say "hey, if it's that easy, I'll do it too".
- RicoElectrico 3y agoI would go even further. I was wondering why most chip companies are so good at being mediocre. Like TI OMAP dropping out of smartphones and so on. But I think it's worthwhile to invert the question. It is quite extraordinary in the silicon space for there to be 1 clear winner like Nvidia or Qualcomm (or Intel not so long ago). So much so, that we can assume they got there by anti-competitive means and rent-seeking measures.
- mschuster91 3y ago> I was wondering why most chip companies are so good at being mediocre. Because anything to do with hardware, particularly anything with silicon, has immense startup costs.
- hashtag-til 3y agoIronically, Open AI are going to face the same gigantic barrier to enter the market. As of today, I say if they go into consumer market they will fail. If they go into specialised server chips, then they would have a chance, with some sort of accelerator over some arm-based chip - similar to what Nvidia is doing with Grace. Still big money to be spent on supporting the existing ecosystem on their hardware.
- layer8 3y agoIt’s inevitable(?) that the trend to vertical integration will continue, slowly pushing more and more non-vertical companies into irrelevance.
- keenmaster 3y agoI bet OpenAI is trying to figure out how to have self-improving AI which suggests modifications to the hardware that runs it. You’d need some hardware expertise in-house for that (in addition to software of course), though not necessarily a big chip company.
- blibble 3y agoyou'd need a lot more capital too a 3mn mask costs what, $20 million each time? using AI generated vomit for that would get expensive pretty quickly
- keenmaster 3y agoThey won’t have trouble getting capital. It’s open checkbooks for them all around.
- blibble 3y agoeven small chip manufacturing at the cutting edge has costs 2-3 orders of magnitude above what they're paying to rent some GPUs in azure
- cmrdporcupine 3y agoEvery company is going to want to avoid paying rent on key infrastructure that they rely on for their business, thus the push to own their own IP and means of production in that regard. It doesn't work out all the time, for sure. In fact it probably fails more than it succeeds. But the motivation is pretty clear.
- llm_nerd 3y agoThis is especially true when you are beholden to a single supplier, with basically no competitive options. Right now nvidia completely owns the AI market, and is exploiting that absolute monopoly with ever escalating pricing, licensing and restrictive usage models. Everyone keeps trying to escape this -- see Tesla and their super-hyped and now apparently abandoned Dojo thing, while they put in their orders for tens of thousands of H100s -- but instead they keep being beholden to nvidia.
- jejeyyy77 3y agothat's what we have. Companies have discovered building their own is better.
- mensetmanusman 3y agoMoores law is dead when it comes to power consumption, that means compute is getting more capital intensive. If you have an algorithm that works and need scale, you must vertically integrate to maintain an edge over those using more general compute architectures.
- deleted 3y ago[deleted]
- scottiebarnes 3y agoWe had that, then we realized that companies who understand all the pieces lead to better user experiences, which is why we all have MacBooks and iPhones.
- rgrieselhuber 3y agoIt also creates walled gardens and reduced incentives to invest in user experience once those walls are built. I switched from Mac to Linux precisely for this reason and the biggest surprise has been that whenever I touch a Mac again it feels like poverty. Not because the UX is bad but because I know how the company behind it operates and I have zero trust for anything that happens on the machine.
- tyre 3y ago> It also creates walled gardens and reduced incentives to invest in user experience once those walls are built. > Not because the UX is bad I don’t see the connection. The first sentence says that walled gardens create bad UX, but Macs are the premier mainstream walled gardens and you don’t find their UX bad.
- tw04 3y agoI dunno, the last two generations of MacBook pro pretty much feature for feature provide fixes for all the widely criticized issues of the last Johnny Ive models. Apple has plenty of faults but they seem to actually be listening to user feedback in some areas despite a captive audience.
- conradfr 3y agoBut you can't run Windows or Linux (not sure of the state of Asahi) on it anymore.
- homarp 3y agonatively. But can you really blame apple for Windows not having an ARM version? https://support.microsoft.com/en-us/windows/options-for-using-windows-11-with-mac-computers-with-apple-m1-and-m2-chips-cd15fd62-9b34-4b78-b0bc-121baa3c568c https://support.microsoft.com/en-us/windows/options-for-usin...
- artursapek 3y ago...why? Products are better when you can control the whole stack.
- amelius 3y agoThat may seem to be an advantage. But because there is only 1 (or a few) companies now controlling the whole stack, you have less choice in the products you can buy. And since the incentives of the vendor may not be aligned with yours, which is increasingly the case if they are a monopoly, then the product is not actually better from the consumer's point of view. Don't like the way OpenAI treats your data, or how you can only run it in the cloud and not on an on-premises server? Or what dataset they used for training? You're out of luck! But if the market were more modular, and lots of small companies could use the same hardware in their products, you'd have something to choose from!
- hef19898 3y agoAll those sweet Microsoft money has to somewhere, doesn't it?
- screye 3y agoWhen hardware companies fail to provide sufficient competition to an extortionate monopoly, the layer1 companies react after feeling the burn for too long. If Nvidia, Amd and Intel were in a battle for offering the best VFM, none of these companies would be hopping into hardware. Apple's strong commitment to chip making coincides with years of stagnation from Qualcomm and Intel. From my experience, companies love nothing more than a 3rd party that solves your problem for you, better than you and at a price that's easily cheaper than what I'd cost to build it in-house. This is especially true when the 3rd party product is an internal spec (gpu, cpu) rather than a competing platform (android auto) There is a reason car companies don't build their own speakers or tires....but still try to build their own UI (no matter how bad)
- throwaway19423 3y agoDealing with this professionally for DNNs. It just doesn't work. The large, important DNN models are so complicated, the toolchains for optimized execution don't do sane things unless you do some sort of vertical integration. The community tried with things like TVM, Halide, ONNX and others .. it is just crazy if you don't have a fully opinioned pipeline. Just my personal opinion.