4 ms·
Yeah, a 7B param LLM (quantized) is pretty fast on even a previous-generation base model MacBook Air with 8 GB RAM.
by pr337h4m 2y ago
Yeah, a 7B param LLM (quantized) is pretty fast on even a previous-generation base model MacBook Air with 8 GB RAM.