>Does this perform better than GPT-4 on any metric? Nothing will. You need a dozen H100s just to run inference for GPT-4 [0]. The point is that smaller models

>Does this perform better than GPT-4 on any metric? Nothing will. You need a dozen H100s just to run inference for GPT-4 [0]. The point is that smaller models can still be very useful. [0] https://www.semianalysis.com/p/gpt-4-architecture-infrastructure https://www.semianalysis.com/p/gpt-4-architecture-infrastruc...