4 ms·
Any one weight, but all of them. And also crushing the architecture itself? I wouldn't pick up 400gb of hardware to run in that mode. I might try it for fun,
by ilc 2mo ago
Any one weight, but all of them. And also crushing the architecture itself?
I wouldn't pick up 400gb of hardware to run in that mode. I might try it for fun, but even then you are looking at handling a 95GB active parameter set.
This is NOT a model for most home labs. I'm sure some can and will use it. But most, should steer clear.
- kadoban 2mo agoI wouldn't just rush out and buy hardware, but there will be benchmarks after a while to make an informed decision. 95GB active is not _too_ bad, would require some creativity and $$, but I bet I could do that at home for less than a cheap car.