At least in terms of self-reported perplexity all the fine-tuned models seem significantly stupider than the raw llama checkpoints. Better for business but not

At least in terms of self-reported perplexity all the fine-tuned models seem significantly stupider than the raw llama checkpoints. Better for business but not nearly as fun or useful for human persons wanting to talk to something that can seem to reason and respond like a human does. And since the llamas are not for profit you can draw your own conclusions. In terms of getting work done 30B and under llamas aren't going to be very helpful. Maybe 65B behaves differently but the 30B and under are just amazing toys; not tools. And, again, if you fine-tune them they get significantly stupider. Think of fine tuning as a lobotomy. The model is more likely to stay on the rails but it loses emergent capabilities.