True. The best solution for small models is to use Project Gutenberg to reduce risk: https://huggingface.co/datasets/manu/project_gutenberg https://huggingface

True. The best solution for small models is to use Project Gutenberg to reduce risk: https://huggingface.co/datasets/manu/project_gutenberg https://huggingface.co/datasets/manu/project_gutenberg It’s also enough data to be Chincilla optimal in under one epoch for SLM’s.