3 ms·
AMD already demonstrated 1T on strix halo clusters. << $10K at original MSRP.
by hedora 2mo ago
AMD already demonstrated 1T on strix halo clusters. << $10K at original MSRP.
- arjie 2mo agoProblem is prefill on these, right? Initial prompt processing takes forever? I suppose you’re right. Cost is not a thing on its own. It’s a performance-cost frontier and one can do CPU inference in the worst case.