2 ms·
>The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data. because the training
by vlyan 12d ago
>The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.
because the training data is full of copyrighted works.
the answer to "what went into the training data" is "everything we could get our hands on".
- fc417fc802 12d agoFor text based just assume "the entirety of anna's archive" and you'll be most of the way there. For multimodal pull up a torrent tracker and sort by size descending if you want to see some of the aggregated datasets.