paguasmar

3 ms·

1.
by paguasmar 23d ago
Great question. The controller provision a replacement automatically. The controller runs continuous health-check polls against the worker’s, if it doesn't respond, provisions a new one. Why not use a AASG? I chose to use a controller
2.
by paguasmar 24d ago
You're right. A CPU only model is definitely is not a real prod workload where you'd need GPU machines. Here is a rough table of model size to instance type to spot $/hr: For up to 8B, you can use a c6i.xlearge which costs as
3.
by paguasmar 24d ago
Basically the CLI 1. compiles your model code and dependencies without requiring Dockerfiles or K8s 2. provisions spot or on-demand instances directly in your own AWS/GCP account (via SkyPilot) 3. it then spins up the runtime and gives
4.
Show HN: Self-host open-source LLMs on AWS with scale-to-zero(github.com)
7 points by paguasmar 24d ago|5 comments
5.
by paguasmar 27d ago
I like the project. I see a lot of potential integrating it with LLM providers in an effort to lower token usage for repetitive tasks. Your solution becomes the "main model" and the LLM the fallback
6.
by paguasmar 27d ago
The UI looks good and aligns well with your retro positioning. Open-source the project is smart to allow the community to build plugins and have fun with the device.
7.
by paguasmar 27d ago
It's great that you found a way to simplify the extraction algorithm. Can you share the PC specs you used to run the test for both the WinZST and 7-Zip experiment?
8.
by paguasmar 28d ago
I see a lot of potential hearing my morning email podcast while driving to work. For folks with kids or driving other people in the car it might be embarrassing reading your sensitive emails out loud, such as dating apps or medical diagnosi
9.
by paguasmar 28d ago
Avoiding MELCloud is the dream. I'd love to experiment this with my Mitsubishi R32 split. Have you tried it on Mitsubishi Heavy Industries models?
10.
by paguasmar 28d ago
Within 10 secs of reading this I was convinced I needed this in our pipeline. For me the next step is plugging this into the company CI/CD to gate SKILL updates and catch tool call regressions before merging
11.
by paguasmar 28d ago
Gotta catch 'em all! For me the next step would be picking a 6 Pokémon squad and generating a combined type cov and weakness matrix