3 ms·
That seems like entirely reasonable variance to me for AI models. For my purposes, that absolutely counts as a solid "replication". I'd probably accept +/- 5 pe
by nerdsniper 3mo ago
That seems like entirely reasonable variance to me for AI models. For my purposes, that absolutely counts as a solid "replication". I'd probably accept +/- 5 percentage points even.
- tadfisher 3mo agoD'oh, they are running the benchmark themselves. Reasonable.