3 ms·
Show HN: Foreman, a self-hosted LLM gateway for cost aware model routing
- AndrewLiu96 3mo ago[flagged]
- midtake 3mo agoName collision with Foreman, the provisioning/patching tool. https://en.wikipedia.org/wiki/Foreman_(software) https://en.wikipedia.org/wiki/Foreman_(software)
- GuestFAUniverse 3mo agoSlop(py) coders don't care. I would vote for the alternative: "Sloppy McSlopGate"
- AndrewLiu96 3mo agoCould you point out where you see the slop in the codebase? I'm more than happy to address it and make the tool better and more useful :)
- TurdF3rguson 3mo agoNot to mention the George Foreman grill
- AndrewLiu96 3mo agoThat was actually one of my naming inspirations, the george foreman grill is a s tier invention
- TurdF3rguson 3mo agoLol. It's an objectively bad grill.
- bigtechisajoke 3mo agoForeman is too well known imo
- AndrewLiu96 3mo agoNoted!
- jsabess24 3mo agoNice
- AndrewLiu96 3mo agoThanks for checking it out!
- gokulrajaram 3mo ago[flagged]
- dilushin 3mo agoI have something simmilar brewed in my multi-agent system, showing and saving cost data on every agent flow run.
- AndrewLiu96 3mo agoThat's awesome! I'd love to check it out and give it a try
- dilushin 3mo agoIt is in my private repo, let see if I can OSS this part )
- anirudhak47 3mo agohow does it compare to sakana?
- AndrewLiu96 3mo agoI assume you're referencing Sakana Fugu? Similar in the sense that there's multiple models involved, but from what I understand Fugu is kind of a black box in terms of what model is used for what. This project is more deterministic, you can pick and choose which model to assign/use for certain tasks, plus this project is open source which Fugu isn't.
- jarodrh 3mo agoInteresting project. Most of what I read appears to deal well with a linear agent session. How does it handle concurrent agent/subagent spawning? Do they fall under the same sessionId (where they're potentially fighting over the warm route breaking it with every task-type change) or get their own individual sessionIds (where you must rewrite the shared prefix for each agent)?
- heliskyr2 3mo ago[flagged]