2 ms·
Along with those factors, there's a reasonably convincing theory going around, complete with some successful experimentation, that training on scraped internet
by crooked-v 3y ago
Along with those factors, there's a reasonably convincing theory going around, complete with some successful experimentation, that training on scraped internet data (with various dates attached to comments, etc) results in seasonally affected answers based on whatever date the model 'thinks' it is when answering.