4 ms·
Probably because they made ASICs to run inference for less.
by giancarlostoro 3mo ago
Probably because they made ASICs to run inference for less.
- brookst 3mo agoAre those actually deployed at scale yet?
- brcmthrowaway 3mo agoYes.
- wmf 3mo agoI hate to disagree with Broadcom Throwaway himself but it's unlikely that the OpenAI Jalapeno ASIC has been deployed yet. It takes 6-12 months to test, develop software, ramp production, etc.