punkpeye

11 ms·

91.
by punkpeye 2y ago
The API still has limits. Even if you are on the highest tier, you will quickly run into those limits when using coding assistants. The value proposition of Glama is that it combines UI and API. While everyone focuses on either one or the o
92.
by punkpeye 2y ago
If you are open to alternatives, try https://glama.ai/gateway We currently serve ~10bn tokens per day (across all models). OpenAI compatible API. No rate limits. Built in logging and tracing. I work with LLMs every day, so
93.
by punkpeye 2y ago
If you are open to alternatives https://glama.ai/models/claude-3-7-sonnet-20250219
94.
by punkpeye 2y ago
https://glama.ai/models/claude-3-7-sonnet-20250219 Will be interesting to see how this gets adopted in communities like Roo/Cline, which currently account for the most token usage among Glama gateway user base.
95.
by punkpeye 2y ago
Just had a chance to play around with 32B model https://glama.ai/models/deepseek-r1-distill-qwen-32b I am using it with Cline VSCode extension to write code. It works impressively well for a model this size. Thanks aga
96.
by punkpeye 2y ago
This is very useful. Thank you. so basically there is not much reason to go beyond DeepSeek-R1-Distill-Qwen-32B, at least for coding tasks
97.
by punkpeye 2y ago
Do we know how do these distilled versions perform in benchmarks?
98.
by punkpeye 2y ago
I don't get something. So I tried hosting this model myself. But the amount of minimum GPU RAM needed is 400gb+ Which even with the cheapest GPU providers will be at least USD 15/hour How is everyone running these models?
99.
Awesome-mcp-clients: A collection of MCP clients(github.com)
1 points by punkpeye 2y ago|0 comments
100.
FastMCP – MCP framework SSE, notifications, events, completions, roots, sampling(github.com)
1 points by punkpeye 2y ago|0 comments
101.
Show HN: FastMCP – MCP framework with image, logging, error handling and SSE(github.com)
3 points by punkpeye 2y ago|0 comments
102.
by punkpeye 2y ago
Been using it. Happy customer. It gave me sanity into otherwise very complex LLM infrastructure. We spend 60k+ every month on LLM calls, so having the backbone to debug when things go haywire has helped a lot.
103.
by punkpeye 2y ago
I think that the competition is good for the community; it has kept me on my toes since the start! For these other projects to succeed, they need to figure out how to create value beyond listing servers, e.g. I am doing this now by testing
104.
by punkpeye 2y ago
A small correction of assumptions regarding #2. This directory is not affiliated with Anthropic. As much as I am pleased by the idea that someone could somehow confuse my hobby project with something that Anthropic could ship, what you see
105.
by punkpeye 2y ago
It is! In many ways I prefer it because it feels more organic and easier to contribute updates to. However, I am curious to see where we are going to be in several months from now. If it is going to grow at the current pace, there will be s
106.
Show HN: Anthropic's MCP Server Directory(glama.ai)
11 points by punkpeye 2y ago|6 comments
107.
by punkpeye 2y ago
Any real-world (open-source) implementations of this?
108.
Appears that GitHub trending is manually curated page
2 points by punkpeye 2y ago|1 comments
109.
by punkpeye 2y ago
If you are interested in discussing this topic, I've also made a Discord server. https://discord.gg/TFE8FmjCdS You might be the first person to join... but I've created it as a place to share my learnings and help
110.
A curated list of Model Context Protocol (MCP) servers(github.com)
4 points by punkpeye 2y ago|1 comments
111.
by punkpeye 2y ago
Hosted the model for anyone to try for free. https://glama.ai/?code=qwq-32b-preview Once you sign up, you will get USD 1 to burn through. Pro-tip: press cmd+k and type 'open slot 3'. Then you can compare qwq again
112.
ShowUI: A lightweight vision-language-action model for GUI agents(github.com)
2 points by punkpeye 2y ago|0 comments
113.
by punkpeye 2y ago
Contrary to the title of the post, Fly.io API remains inaccessible. Meaning, users still cannot access deploys/databases, etc. For accurate updates, follow https://community.fly.io/t/fly-io-site-is-currently-inacce
114.
by punkpeye 2y ago
How does it compare in terms of price?
115.
by punkpeye 2y ago
wow, this will be huge
116.
by punkpeye 2y ago
What's use case for this?
117.
by punkpeye 2y ago
This makes me think about the email from Greg and Ilya to Sam https://www.reddit.com/r/OpenAI/comments/1gsnxmy/more_lawsui... I guess I spend my entire day working with LLM prompts, CoT, etc. so maybe I
118.
by punkpeye 2y ago
They are fundamentally different. If Cloudflare provided a way to host docker containers with volumes though, that would be game over for so many paas platforms.
119.
by punkpeye 2y ago
It's actually due to fly.io outage https://news.ycombinator.com/item?id=42241851
120.
by punkpeye 2y ago
It is not reflected in their status page, but fly.io itself is not even loading.

More ›