detente18

7 ms·

31.
by detente18 3y ago
Hey bredren - our supported list (if that's helpful) is here https://litellm.readthedocs.io/en/latest/supported/ We're adding new integrations every day, so if there's any specific one you&#x27
32.
by detente18 3y ago
Hi @d4rkp4ttern - yes it's standardized to the openai format - https://litellm.readthedocs.io/en/latest/stream/
33.
by detente18 3y ago
How do you plan on deploying llama 2? Is that via ollama/fastchat/etc.? We're actively building out integrations to different providers, so if you have any preferred tooling - let me know!
34.
by detente18 3y ago
Hi @deet - Yes it is! This automatically stores the cost per query to the Supabase table - here's how: https://github.com/BerriAI/litellm/blob/80d77fed7123af222011... If you have ideas for improvement -
35.
by detente18 3y ago
Hey @jmorgan - we love ollama! Re: LocalLLM's like Llama2 - yes we support self-deployed models, through Huggingface, Replicate, TogetherAI integrations. We're missing support for locally deployed models - and would love the help!
36.
by detente18 3y ago
Thanks - that's very kind.
37.
by detente18 3y ago
Hey @breckenedge yes it does! Exactly the same way as the openai-python sdk. Here's our code tutorial for it https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
38.
by detente18 3y ago
Hey @downvotetruth, the issues/PR's are actually ours (the creators). We're actively working + using this repo, and use these as ways to keep track of ongoing work. We're super open to contributions and help though!
39.
by detente18 3y ago
This is awesome!
40.
by detente18 3y ago
Thanks
41.
by detente18 3y ago
Thanks!
42.
by detente18 3y ago
azure uses the openai python sdk, just remaps certain components. The models are also user-named. This makes it hard to detect if a model passed in is an azure model
43.
by detente18 3y ago
You can use tenacity for retries and wouldn't you want to cache the request / response around the endpoint instead of the gpt call -> that's what we ended up doing. Streaming output and function-calling support is interest
44.
Tutorial: Caching for High-traffic LLM Apps without dropping requests(github.com)
1 points by detente18 3y ago|0 comments
45.
by detente18 4y ago
Google form to let you rapidly prototype different LLM App strategies (how to chunk and vectorize? What type of agent to initialize?) through a google form.
46.
Show HN: Google Colab 1-click deploy LLM Apps(colab.research.google.com)
3 points by detente18 4y ago|0 comments
47.
Show HN: Windows OS for LLM Apps(berri-ai.ghost.io)
2 points by detente18 4y ago|0 comments
48.
Show HN: Rapidly prototype and launch LLM Apps(berri.ai)
1 points by detente18 4y ago|0 comments
49.
by detente18 4y ago
We built a bot to help you get started / answer any question you have about the LangchainAI (building AI Apps with LLMs) repo!
50.
Introducing “Clerkie“: A LangChain Q&A bot for AI developers(huggingface.co)
7 points by detente18 4y ago|2 comments
51.
Show HN: Betterpipe – Easy logging for ML deployments(github.com)
2 points by detente18 4y ago|0 comments
52.
by detente18 4y ago
currently it's to the server - although running it locally might be an interesting idea.
53.
Show HN: Clerkie AI – A GPT-3 based CLI tool that debugs your code(github.com)
6 points by detente18 4y ago|2 comments
54.
Clerkie AI – A GPT-3 based CLI tool that helps you debug your code(clerkie.co)
1 points by detente18 4y ago|1 comments
55.
by detente18 4y ago
We built ClerkieCLI - a GPT-3 based tool that: - automatically detects errors on your terminal, - identifies the programming language, - provides an explanation of the error and suggested fix right on your terminal.
56.
by detente18 4y ago
Hi HN! Built a quick tool I thought would be interesting - it’s a chrome extension that uses GPT-3 under the hood to help debug your programming errors when you paste them into Google (“eg. TypeError:…”). This is definitely early days, so i
57.
by detente18 4y ago
Thanks kevin! Hope you enjoy it
58.
Speech to Text Alternatives?
2 points by detente18 6y ago|2 comments
59.
Ask HN: How to create uniqueness as a B2B AI startup
1 points by detente18 6y ago|0 comments