6 ms·
A 24gb model is fast and ranks 3. A 70b model is slow and 8. A top tier hosted model is fast and 100. Past what specialized models can do, it's about a mixtur
by vid 2y ago
A 24gb model is fast and ranks 3.
A 70b model is slow and 8.
A top tier hosted model is fast and 100.
Past what specialized models can do, it's about a mixture/agentic approach and next level, nuclear power scale. Having a computer with lots of relatively fast RAM is not magic.