3 ms·
I do and built Assistants API compat layer for Groq and Anthropic: https://github.com/supercorp-ai/supercompat https://github.com/supercorp-ai/supercompat I’d
by Nedomas 2y ago
I do and built Assistants API compat layer for Groq and Anthropic: https://github.com/supercorp-ai/supercompat https://github.com/supercorp-ai/supercompat
I’d argue that Assistants API DX > manual completions API.
- tomrod 2y agoAye, but your FinOps will be comolaining even with simple use.
- Nedomas 2y agoAssistants API use in prod used to suck because it would send full convo on each message. But last month they added an option to send truncted history so its no longer 2$ a pop thankfully. Also Grok, Haiku and Mistral is cheap
- brianjking 2y agoAre you using Assistants API v2 with streaming?
- Nedomas 2y agoYeah, I do both in prod and in the lib. In the lib I even ported Anthropics streaming API to be OpenAI compatible. Will write the docs over the coming days if interested.