3 ms·
I do hope we converge on a standardized API and schema for this. Testing and integrating multiple LLMs is tiresome with all the silly little variations in API a
by rcarmo 3y ago
I do hope we converge on a standardized API and schema for this. Testing and integrating multiple LLMs is tiresome with all the silly little variations in API and prompt formatting.
- deleted 3y ago[deleted]
- TZubiri 3y agoLangchain. But it's too bleeding edge, you are asking a lot. Just do the work and don't be spoiled senseless
- rcarmo 3y agoLangchain, for all its popularity, is some of the worst, most brittle Python code I’ve ever seen or tried to use, so I’d prefer to have things sorted out for me at the API level.
- supafastcoder 3y agoI switched to using Instructor/Marvin which works really nicely with native pydantic models and gets out the way for everything else.
- cjonas 3y agoImo it's unfortunate that python is the dominant tech of this domain. Typescript is better suited for the inference side of things (I know there a ts version of most things, most most companies are looking for python dev)
- rcarmo 3y agoPython is fine. The problem is all the folk writing Python as if they were doing Java cosplay and without any tests or type annotations.
- ilaksh 3y agoIt looks very similar if not identical to OpenAI?
- habosa 3y agoOpenRouter is a great step in that direction: https://openrouter.ai/ https://openrouter.ai/
- sdeep27 3y agocheck out LiteLLM... been using in (lite) production and they make it easy to switch between models with a standardized API.