3 ms·

How many users can you serve with that?

• fragmede 5mo ago
  For the H200, between 150-700. The GB200 gets you something like 2-10k users.
  • forrestthewoods 5mo ago
    Whoa. How on earth can one system serve 2000 potentially concurrent users?