3 ms·
Somewhat off topic: Is there a similar "magic value card" for low memory (2GB?) 8-bit LLMs? Since memory is the expensive bit, surely there are low cost low m
by algo_trader 3y ago
Somewhat off topic:
Is there a similar "magic value card" for low memory (2GB?) 8-bit LLMs?
Since memory is the expensive bit, surely there are low cost low memory models?
- KeplerBoy 3y agoI believe that's what tenstorrent is aiming for.
- abdullin 3y agoThe main offer of Tenstorrent goes into server racks and is designed to form clusters. Standalone cards are more like dev kits. (I’ve been tracking Tenstorrent for 3+ years and currently have Grayskull in ML test rig together with 3090)