3 ms·
Yeah, the assistants api is pretty great. Curious if you’ve faced issues with certain things not working out of the blue forcing you to re-run threads? For exa
by Sai_ 3y ago
Yeah, the assistants api is pretty great. Curious if you’ve faced issues with certain things not working out of the blue forcing you to re-run threads?
For example, i have an assistant which is supposed to parse an uploaded file and extract useful info from it. To use this assistant, I create a thread and a run and attach it to the assistant with a different file-id. About half the time, the assistant simply throws up its hands and says it can’t parse the file I supplied with the thread. Retrying a few times seems to do the trick.
- sbrother 3y agoThe assistants API is fantastic; I was just getting started with it. This news makes me reconsider -- but I also think it's inevitable that a compatible API will be released with open source underlying LLMs. I've deployed the OpenAI-compatible completions API over Llama2 in production with vLLM, and it works perfectly. Do you know if there are any projects working on this? Even something like a high quality json-tuned base model would go a huge way toward replicating OpenAI's current product.
- Sai_ 3y agoSorry, no idea if what you’re looking for exists. For now, I was looking at integrating with OpenAI and productising some th ing but this situation is making me nervous.