3 ms·
Well even programmable ASICs like Cerebras and Groq give many-multiples speedup over GPUs and the market has hardly reacted at all.
by roncesvalles 8mo ago
Well even programmable ASICs like Cerebras and Groq give many-multiples speedup over GPUs and the market has hardly reacted at all.
- mips_avatar 8mo agoThe problem with groq was they only allowed LORA on llama 8b and 70b, and you had to have an enterprise contract it wasn't self service.
- fooker 8mo ago> market has hardly reacted at all Guess who acqui-hired Groq to push this into GPUs? The name GPU has been an anachronism for a couple of years now.
- fuck_google 8mo ago[dead]
- brainless 8mo agoSeems both Nvidia (Groq) and OpenAI (Codex Spark) are now invested in the ASIC route one way or another.
- IshKebab 8mo agoCerebras gives a many multiple speedup but it's also many multiples more expensive.