I believe the best results will come from training the base LLM on as many sources of quality information as possible, and then fine tuning it with a narrower s

I believe the best results will come from training the base LLM on as many sources of quality information as possible, and then fine tuning it with a narrower set of data later on. Here’s a small scale example where someone took LLaMa/Alpaca and fined tuned it with all the scripts from the first 12 seasons of The Simpsons. https://replicate.com/blog/fine-tune-llama-to-speak-like-homer-simpson https://replicate.com/blog/fine-tune-llama-to-speak-like-hom...