3 ms·
I believe Furiosa hardware is a variant of TPU, and that's pretty much why they can beat Nvidia on LLM inference. GPUs are more general purpose, which means Fur
by yencabulator 10mo ago
I believe Furiosa hardware is a variant of TPU, and that's pretty much why they can beat Nvidia on LLM inference. GPUs are more general purpose, which means Furiosa can cut some of the overhead with designs dedicated for matrix multiplication only.
https://furiosa.ai/blog/tensor-contraction-processor-ai-chip-architecture https://furiosa.ai/blog/tensor-contraction-processor-ai-chip...