4 ms·
LLMs vary in there resource requirements. The best models at the moment require beefy hardware, but you could still run a handful of 7B models, at the same tim
by vinnymac 3y ago
LLMs vary in there resource requirements.
The best models at the moment require beefy hardware, but you could still run a handful of 7B models, at the same time, with a top of the line laptop.
With a custom build they could do something far more impressive.