4 ms·
I’m afraid you’re going to have to start randomizing your benchmarks somehow. I’m sure these models are trained on this problem by now.
by dozerly 3mo ago
I’m afraid you’re going to have to start randomizing your benchmarks somehow. I’m sure these models are trained on this problem by now.
- tyre 3mo agoIf they did, they launched early! If they didn’t, their training data contains a bunch of poorly executed pelicans on bikes by other models.
- tstrimple 3mo agoWait. Based on the results of the test linked above you think this model might have been trained to produce it? Did you look at the results?!
- argee 3mo agoThat’s the problem. If all (or zero) models were trained on it, it would be fine as a benchmark.
- 0-_-0 3mo agoIt's not a benchmark, it's a meme
- OrangeMusic 3mo agoTo be fair, the "they're trained on this benchmark" response is also a meme.