4 ms·
Show HN: Agentpanel – Universal LLM API Written in Rust
Agentpanel is an observability platform for optimizing the control flow, performance, token usage, and correctness of LLM/AI agents!
Built-in @rustlang, the first release of Agent Panel currently features an AI gateway that provides seamless access to 100+ LLMs across 20+ platforms, including OpenAI GPT-4o, Gemini 1.5 Pro latest, AnthropicAI Claude 3.5, MistralAI, Cohere, Groq,Perplexity AI, and more.
- akash_sky 2y agogg stuff
- hamasho 2y agoInteresting! And it looks much sane compared to LangChain. Question: do almost all LLM APIs have the same roles "user", "assistant", and "system"?
- hackintoshrao 2y agoThank you. Yes, almost all LLM APIs have the same roles. Let me know your thoughts once you try the project.
- mathnmusic 2y agoGemini models don't have "system" roles.