To my untrained eye, this looks more like an instruct dataset. For just plain text, I really like this one - https://huggingface.co/datasets/roneneldan/TinySto

To my untrained eye, this looks more like an instruct dataset. For just plain text, I really like this one - https://huggingface.co/datasets/roneneldan/TinyStories https://huggingface.co/datasets/roneneldan/TinyStories