4 ms·
If the AI can distinguish between good and bad reasoning, it can select training material that has a higher average than than the corpus. If it can output data
by swid 3y ago
If the AI can distinguish between good and bad reasoning, it can select training material that has a higher average than than the corpus. If it can output data that covers the range, it can generate its own data to bootstrap higher functioning models (like alpha go playing against itself to achieve superhuman go playing skills).
I also don’t think you need to remove the dumb comments from the training material anyway. The AI could be able to simulate either someone of 80 IQ or 180 IQ, producing output consistent with both personas.