3 ms·
Show HN: Open-source multi-modal LLM chat agent
Hi everyone,
I’m learning LLM and AI. And I’m building a multi-modal full stack LLM chat agent. [0]
Using semantic-router for dynamic conversation routing, and LiteLMM for model providers.
It was lots of fun to learn and build.
Here is the full list of large language models. I will update more models in the future. [1]
And, of course you can use Llama 3 via Ollama locally!
I will be adding function calling support (tools use) for the models to have it more capable, like an agent, in the future.
Hope this project helps everyone to try out using multi-modalities LLM providers agent!
[0] GitHub: https://github.com/vinhnx/VT.ai https://github.com/vinhnx/VT.ai
[1] List of LLM models currently supported: https://github.com/vinhnx/VT.ai/blob/main/src/vtai/llms_config.py https://github.com/vinhnx/VT.ai/blob/main/src/vtai/llms_conf...
- mrbishalsaha 3y agoI am really interested in a LLM router that can track the usage and tokens used to measure the cost and put int rate limits. What this will do is help keep cost down even while using multiple LLMs. I think this project will be a great starting point.
- vinhnx 3y agoThank you for your compliment! I still learning and experimenting with LLM and gen AI for now Looking at LiteLLM docs, which is quite extensive I think for tracking usages and tokens management is a great use case, which I think also have covered in their docs. Cheers, Vinh