3 ms·
I don't agree. At the moment companies like NVIDIA take several times what it costs to make a chip. I think the fair split for the technology contribution is mo
by impossiblefork 1mo ago
I don't agree. At the moment companies like NVIDIA take several times what it costs to make a chip. I think the fair split for the technology contribution is more like 50-50, maybe even 30-70 in favour of the manufacturer.
With competition we will actually have the fair split, whatever that is, and thus much lower prices.
At the moment, to have a big AI firm, or really AI firm at all, you need to be blessed by NVIDIA, in the form of receiving circular financing for your compute. They know that their prices aren't fair, or competitive.
Commoditization of inference is the end of that. The end of the mega-premium on inference hardware, and it's good not only for people who like running their LLMs, but it's the first step towards commoditization of training.
- kubb 1mo ago10-90 is the fair split.
- impossiblefork 1mo agoOne could hope so, or it would be best for me if it were. I don't think I can count on that though. I don't think I can hope for anything better than 30-70 in my lifetime, and I think 10-90 almost requires you to buy the design firm.