3 ms·
There's been demand for LLM accelerators since late 2022, but so far only the Groq cards have materialized and those aren't really viable for anyone but high e
by moffkalast 3y ago
There's been demand for LLM accelerators since late 2022, but so far only the Groq cards have materialized and those aren't really viable for anyone but high end enterprise datacenter use.
Literally nobody's making these things yet, Nvidia gaming GPUs remain the best price to performance option lol. Intel Arc only does compute work through Vulkan which is not exactly comparatively fast yet, so despite being well priced for the VRAM they offer they're not seriously considered.