4 ms·
relevant note is that we finetuned by having the human also use arrow keys which keeps it in-distribution but also slower to collect
by g413n 7mo ago
relevant note is that we finetuned by having the human also use arrow keys which keeps it in-distribution but also slower to collect