3 ms·
But this is the same version that changes without a change of the version number.
by jacquesm 3y ago
But this is the same version that changes without a change of the version number.
- airgapstopgap 3y agoWell, people suspect it isn't, and it's not like we can see the internal version designation, and it's not even like we would care a lot, if it performed identically from day to day. Indeed, you could do better or worse with the exact same raw checkpoint, just depending on inference-optimizing tricks.
- pmontra 3y agoSo the version number is the day the benchmark is run. Version yyyy-mm-dd