2 ms·
>Then costs would explode of course. You can slash the costs by using cheap LLMs once your workflow is stable (but pricey to run!). Fine-tuning, prompt optimiz
by Xmd5a 1y ago
>Then costs would explode of course.
You can slash the costs by using cheap LLMs once your workflow is stable (but pricey to run!). Fine-tuning, prompt optimization, special distillation techniques, this is a well covered area.
- vemv 1y agoYes, I've had such a system in the back of my mind for a few months, mixing and matching cheaper/local and more expensive LLMs. Sometimes I've wanted to implement it but I sense that someone else will sooner or later, putting in more resources than I could currently. In the meantime I'm happy with vanilla CC usage.