4 ms·
gotta prototype the thing somewhere. If it turns out that the LLM algos become pretty mature I suspect accelerators of all kinds will be baked into silicon, es
by someguydave 2y ago
gotta prototype the thing somewhere. If it turns out that the LLM algos become pretty mature I suspect accelerators of all kinds will be baked into silicon, especially for inference.
- jsheard 2y agoThat's the thing though, we're already there. Every new consumer ARM and x86 ASIC is shipping with some kind of NPU, the time for tentatively testing the waters with FPGAs was a few years ago before this stuff came to market.
- PaulHoule 2y agoBut the NPU might be poorly designed for your model or workload or just poorly designed.
- mistrial9 2y agolike this? https://www.d-matrix.ai/product/ https://www.d-matrix.ai/product/