4 ms·
You might be right, but Google's recommendation was temp 1 etc primarily because all their benchmarks were used with these numbers, so it's better reproducibili
by danielhanchen 6mo ago
You might be right, but Google's recommendation was temp 1 etc primarily because all their benchmarks were used with these numbers, so it's better reproducibility for downstream tasks
- sillysaurusx 6mo agoFair, though putting a note in the readme about temperature 0.7 couldn't hurt. I wonder why they do benchmarks with 1 instead of 0.7... that's strange. 0.7 or 0.8 at most gives noticeably better samples.
- davedx 6mo agoReproducibility. They're benchmarks.
- sillysaurusx 6mo agoReproducibility is a matter of using the same input seeds, which jax can do. 0.7 vs 1.0 would make no difference for that. Without seeds, 0.7 would be less random than 1.0, so it'd be (slightly) more reproducible.