Having just started to dabble with training LLMs, it seems training a model if you have a training and validation data set is fairly trivial. Creating a good an

Having just started to dabble with training LLMs, it seems training a model if you have a training and validation data set is fairly trivial. Creating a good and sufficiently large training and validation data set seems to be the hard part. Sourcing, cleaning, curating, labeling, generating and quality controlling training data is hard and a lot of work, at least has been for the projects I've dabbled with.