I'd suggest you take a read on HuggingFace's writeup when they trained smolLM3 https://huggingface.co/spaces/HuggingFaceTB/smol-training-playbook https://huggi

I'd suggest you take a read on HuggingFace's writeup when they trained smolLM3 https://huggingface.co/spaces/HuggingFaceTB/smol-training-playbook https://huggingface.co/spaces/HuggingFaceTB/smol-training-pl... rare detailed insight on the entire process