Phind-70B is a specialist model, unlike GPT-4. It optimizes for a different function than GPT-4 and therefore needs fewer parameters to learn it. It's also tru

Phind-70B is a specialist model, unlike GPT-4. It optimizes for a different function than GPT-4 and therefore needs fewer parameters to learn it. It's also true that specialist models still need to be sufficiently large to be able to reason well, but we've observed diminishing returns as models get larger.