2 ms·
If all the training data is in the txt files, it is obviously trained on copyrigthed material, and immensly low amounts of text. Im impressed if the outputs eve
by gunalx 2y ago
If all the training data is in the txt files, it is obviously trained on copyrigthed material, and immensly low amounts of text. Im impressed if the outputs even start to make sense at all.
- nickpsecurity 2y agoTrue. The best solution for small models is to use Project Gutenberg to reduce risk: https://huggingface.co/datasets/manu/project_gutenberg https://huggingface.co/datasets/manu/project_gutenberg It’s also enough data to be Chincilla optimal in under one epoch for SLM’s.
- deleted 2y ago[deleted]
- deleted 2y ago[deleted]