19 ms·
So I guess, 1. This chip for an 8B model even if it was done at 5nm would still be twice the size of a conventional CPU die so what are the yields for this goi
by hacker_homie 2mo ago
So I guess,
1. This chip for an 8B model even if it was done at 5nm would still be twice the size of a conventional CPU die so what are the yields for this going to be like for even a 30B model?
2. They say 2 months but llama 3.1 was released 2024, ~2 years which is normal lead time for silicon, I suspect this would take longer if the architecture is not llama?
3. Can google do the same thing in house with their Gemma 4 series (two year lead time puts Gemma 4 on silicon April 2028) ?
I can see the benefit for hyper scalers but at the rate of model turn over does this type of investment make sense?
- harhargange 2mo agoExactly, what will be the size of big models? Maybe they aren’t targeting big models but where do they give size estimates?