That does indeed sound crazy. But finetuning is also a commodity these days. You can train a good Mistral LoRA in under 24 hours on a single consumer GPU. We’re

That does indeed sound crazy. But finetuning is also a commodity these days. You can train a good Mistral LoRA in under 24 hours on a single consumer GPU. We’re talking about $10 of compute. You can run a dozen of these LoRAs atop the same base model on the same infrastructure for a dozen specific use cases. The inference quality, performance and cost can all be substantially better than GPT4 with prompting.