I suspect the biggest most powerful model could easily use hundreds or maybe thousands of H100's. And the 'search' part of it could use many of these clusters

I suspect the biggest most powerful model could easily use hundreds or maybe thousands of H100's. And the 'search' part of it could use many of these clusters in parallel, and then pick the best answer to return to the user.