4 ms·
Model quality matters a ton too. They aren't serving OpenAI or Anthropic models, which are state of the art.
by robrenaud 3y ago
Model quality matters a ton too. They aren't serving OpenAI or Anthropic models, which are state of the art.
- verdverm 3y agoResearch suggest most answers and use cases do not require the largest, most sophisticated models. When you start building more complex systems, the overall time increases from chaining and you can pick different models for different points