2 ms·
There's a linked blog post[0] that goes more into the methodology and reasoning. "As mentioned in the hacker news discussion, the model doesn't change daily. [
by addandsubtract 3y ago
There's a linked blog post[0] that goes more into the methodology and reasoning.
"As mentioned in the hacker news discussion, the model doesn't change daily. [...] As OpenAI releases incremental updates, we'll see the model change automatically and be able to judge outputs. A single sample per day leads to quite different results, but that's fine I think. What I expect to see a year from now is an evolution of output. In variance: how varied are the outputs over a month?"
So yes, they could just produce 100 images with each new model release, but chose to spread those out over 1 per day instead. Is it the most scientific way to measure progress? No. Is it more fun and interesting to check back daily? Probably.
[0] https://adamkdean.co.uk/posts/gpt-unicorn-a-daily-exploration-of-gpt-4s-image-generation-capabilities https://adamkdean.co.uk/posts/gpt-unicorn-a-daily-exploratio...
- imdsm 3y agoThanks, fun and light-hearted is the approach I went for