You need at least 5x Pro 6000 (for smaller contexts), let's say Max-Q edition running at 300W, so overall you get a minimum of 1500W. You get around 6 tokens/s

You need at least 5x Pro 6000 (for smaller contexts), let's say Max-Q edition running at 300W, so overall you get a minimum of 1500W. You get around 6 tokens/second which is not great but not terrible. If you use very long prompts, things get bad.