4 ms·
I wonder if there's any weighting done based on things like upvotes in their training sets, or if the consider all answers equally?
by entuno 2y ago
I wonder if there's any weighting done based on things like upvotes in their training sets, or if the consider all answers equally?
- djhn 2y agoI thought that was the entire ”value” of Twitter, Reddit, SO and other such platforms for LLM training? It’s not like we haven’t got higher quality corpora, on average. They’re just poorly annotated.