4 ms·
Right but it probably takes like 8-10 H100s to run Claude Opus for inference just memory wise? I'm far from an expert just asking. Does "one" Claude Opus insta
by WXLCKNO 1y ago
Right but it probably takes like 8-10 H100s to run Claude Opus for inference just memory wise? I'm far from an expert just asking.
Does "one" Claude Opus instance count as the full model being loaded onto however many GPUs it takes ?