7 ms·
Buy any Strix Halo box and have fun with your 128GB of VRAM.
by kroaton 6mo ago
Buy any Strix Halo box and have fun with your 128GB of VRAM.
- 2001zhaozhao 6mo agoI wonder whether it is much more cost-effective in terms of token throughput / hardware+power cost to get actual GPUs instead, given that the model size is only 27B.