santiago-pl

5 ms·

31.
by santiago-pl 6mo ago
I'll consider it for sure.
32.
by santiago-pl 6mo ago
It's like fuel costs in a supply chain. When you buy apples at the store, you don't think about oil prices. But if trucks ran on something cheaper, more efficient, or less taxed, the apples on the shelf would be cheaper too.
33.
by santiago-pl 6mo ago
"... and I don't see if I would be able to track usage from individual end-users through a header". Currently we have a unified concept of User-Paths. Once you add a specific header OR assign User-Path to an API key, you can
34.
by santiago-pl 6mo ago
The LiteLLM SDK is intentionally on the website. You can "talk" to GoModel with it because both projects use an OpenAI-compatible API under the hood. You can use it like this: from litellm import completion print(completion(
35.
by santiago-pl 6mo ago
Yes, the number of meaningful providers might be around 20-30.
36.
by santiago-pl 6mo ago
First, GoModel is designed to be flexible. If you add an extra field, it tries to pass it through in the appropriate place (Postel's law) Therefore there's a good chance that if they make a minor API-level change, GoModel will han
37.
by santiago-pl 6mo ago
I'll take a closer look at it over the next few days. However, it might be challenging, considering that Claude Code with a subscription no longer officially works with OpenClaw.
38.
by santiago-pl 6mo ago
Thanks for raising it! Since vLLM has an OpenAI-compatible API, this should work for now: docker run --rm -p 8080:8080 \ -e OPENAI_API_KEY="some-vllm-key-if-needed" \ -e OPENAI_BASE_URL="http://host.dock
39.
by santiago-pl 6mo ago
1. Yes, we have OpenAI-compatible API and we develop GoModel with Postel’s law in mind: https://gomodel.enterpilot.io/docs/about/technical-philosoph... . 2. Regarding being open-source and the license, I've d
40.
by santiago-pl 6mo ago
You are not the first person who has asked about it. It looks like a useful feature to have. Therefore, I'll dig into this topic more broadly over the next few days and let you know here whether, and possibly when, we plan to add it.
41.
by santiago-pl 6mo ago
This comment looks like AI-generated. However IIUC what you're asking for - it's already in the dashboard! Check the Usage page.
42.
by santiago-pl 6mo ago
I would love to keep it open source forever, but I can't promise that for now. I've written a whole doc page about it if you're curious: https://gomodel.enterpilot.io/docs/about/license
43.
by santiago-pl 6mo ago
Agree and thank you! Please let us know if you'd like to give it a try and if you miss any feature in GoModel.
44.
by santiago-pl 6mo ago
First of all, GoModel doesn't have a separate private repository behind a paywall/license. It's more lightweight and simpler. The Bifrost docker image looks 4x larger, at least for now. IMO GoModel is more convenient for debu
45.
Show HN: GoModel – an open-source AI gateway in Go(github.com)
217 points by santiago-pl 6mo ago|75 comments
46.
by santiago-pl 7mo ago
It reminds me of Anthropic's Super Bowl ad: “Can I get a six pack quickly?” It actually turned out to be true.
47.
by santiago-pl 7mo ago
I like how the plots look! In recent months, I’ve been making charts for the benchmarks just by talking to Claude Code or Codex: “Generate the charts for this and that.” I could try pointing it to your project next time. It would be easier
48.
by santiago-pl 7mo ago
It looks like Trivy was compromised at least five days ago. https://www.wiz.io/blog/trivy-compromised-teampcp-supply-cha...
49.
UK government publishes guidance on AI coding assistants(gov.uk)
1 points by santiago-pl 7mo ago|1 comments
50.
by santiago-pl 7mo ago
It's always interesting to read how the government is introducing AI into its work. "The programmer is responsible for code produced" - that is definitely worth putting into practice. "Providing more context to AI models
51.
by santiago-pl 7mo ago
Si vis pacem, para bellum. Just because I have a knife doesn't mean it affects the stability of my neighborhood. Even if I use my knife to kill a killer, that doesn't necessarily affect the stability of my neighborhood. It could e
52.
by santiago-pl 8mo ago
It reminds me of a fun fact: HTTP/0.9 websites are the fastest because they were created years ago and have simple content.
53.
by santiago-pl 8mo ago
Hey Nathan, I’m also working on the best AI gateway written in Golang :) https://github.com/ENTERPILOT/GOModel/ It’s open-source and progressing really fast! I noticed that our project has a couple more GitHub sta