3 ms·
It's absolutely relevant if we're discussing SOTA models with huge computing requirements on large clusters, that are plausibly tightly coupled to the physical
by qlte 13d ago
It's absolutely relevant if we're discussing SOTA models with huge computing requirements on large clusters, that are plausibly tightly coupled to the physical datacenter architecture they were developed for to optimize performance.
- petesergeant 12d agoThis sounds like magical thinking. The right couple of AWS or DO keys get you an environment entirely capable of hosting GLM 5.3. I'm sure Fable and Sol run _best_ in their own special aquariums, but "optimized for a particular cluster" != "can only run on that cluster". There's no reason to think you can't run them if you have the weights on your local university's cluster.