2 ms·
Finally an AI story here so I can post about leaving Anthropic. Sorry guys, yes, Claude is the best model, but your lack of support for structured responses le
by nprateem 1y ago
Finally an AI story here so I can post about leaving Anthropic.
Sorry guys, yes, Claude is the best model, but your lack of support for structured responses left me no choice.
I had been using Claude in my Saas, but the API was so unreliable I'd frequently get overloaded responses.
So then I put in fallbacks to other providers. Gemini flash was pretty good for my needs (and significantly cheaper), but failed to follow the XML schema in the prompt that Claude could follow. Instead I could just give a pydantic schema to constrain it.
The trouble is the Anthropic APIs just don't support that. I tried using litellm to paper over the cracks but no joy. However, OpenAI does support pydantic.
So i was left with literally needing twice as many prompts to support Gemini and Anthropic, or dropping Anthropic and using Gemini with OpenAI as a fallback.
It's a no-brainer.
So you guys need to pull your fingers out and get with the programme. Claude being good but also more expensive and not being compatible with other APIs like this is costing you customers.
Shame, but so long for now...