2 ms·
For the H200, between 150-700. The GB200 gets you something like 2-10k users.
by fragmede 7mo ago
For the H200, between 150-700. The GB200 gets you something like 2-10k users.
- forrestthewoods 7mo agoWhoa. How on earth can one system serve 2000 potentially concurrent users?