3 ms·

Anyone who has used gpt-x via openai vs microsoft has experienced this very clearly.

• energy123 6mo ago
  Which one is better?
  • weli 6mo ago
    As a rule of thumb inference offered by the model labs are closer to the "true implementation" compared to third parties. They have other problems though.
  • dannyw 6mo ago
    For OpenAI, OpenAI direct has always been better; except maybe early 2023-era when OpenAI Platform was not that stable or reliable yet. For Anthropic, it can vary based on model and time. For Opus 4.7, Bedrock is the clear winner in TPS by leaps: https://artificialanalysis.ai/models/claude-opus-4-7/providers#speed https://artificialanalysis.ai/models/claude-opus-4-7/provide...
    • spindump8930 6mo ago
      That artificial analysis page has some great references for this, thanks for sharing.