3 ms·
Or better; write your software such that you can scale to tens of thousands of concurrent users on a single machine. This can really put the savings into perspe
by jongjong 8mo ago
Or better; write your software such that you can scale to tens of thousands of concurrent users on a single machine. This can really put the savings into perspective.
- swiftcoder 8mo agoIf you were to read TFA, it is about ML training workloads, not web servers
- jongjong 8mo agoWell the article starts out with a suggestion that we should all get a data center... It's quite a jump to assume that everyone reading this article needs to train their own LLMs.