4 ms·
Right, the nvidia card maxes out at 24GB.
by cjbprime 2y ago
Right, the nvidia card maxes out at 24GB.
- vid 2y agoA 24gb model is fast and ranks 3. A 70b model is slow and 8. A top tier hosted model is fast and 100. Past what specialized models can do, it's about a mixture/agentic approach and next level, nuclear power scale. Having a computer with lots of relatively fast RAM is not magic.