2 ms·
> control over the model used but you lose access to the most capable models, you can run only the small ones
by dist-epoch 5mo ago
> control over the model used
but you lose access to the most capable models, you can run only the small ones
- bel8 5mo agoAnd they run slower and quantized.
- lowbloodsugar 5mo agoSure. I have unlimited credits for AI with my job, but I’m learning by running things locally. Start by running OpenRouter, then downloading open source tools to run locally, then modifying some python, now creating pipelines in rust. Yes, the irony is that I’m using Opus to crack these things open.