3 ms·
There are techniques for this called "curriculum learning" and "textbooks". I'm not sure exactly what is in the textbooks since I admit to not reading the pape
by astrange 3y ago
There are techniques for this called "curriculum learning" and "textbooks".
I'm not sure exactly what is in the textbooks since I admit to not reading the papers yet.
I'm personally wondering if you could increase the reliability of training on web data by labeling it with where each document came from, so it knows different authors disagree on things. But this brings back the issue where people don't like it if a model can write "in the style of Author Name"…