3 ms·

ok! So if someone uses an existing, checkpointed, open source model then the answer is yes the results are valid and it doesn't matter that the tests are publi

by stale2002 6mo ago

ok! So if someone uses an existing, checkpointed, open source model then the answer is yes the results are valid and it doesn't matter that the tests are public.

measurablefunc 6mo ago
Yes, assuming the checkpoint was before the announcement & public availability of the test set.