2 ms·
You don't know what the training data is and what each category's weights are, so how can you assume that?
by satvikpendem 2y ago
You don't know what the training data is and what each category's weights are, so how can you assume that?
- dekhn 2y agoMost use common crawl, and most seem to upweight the scientific publication part of it (from what I gather speaking to folks who train LLM models).