3 ms·
I would hope Simon would not fall victim to such shenanigans, and has his own test dataset.
by jgalt212 2y ago
I would hope Simon would not fall victim to such shenanigans, and has his own test dataset.
- stavros 2y agoI'm not saying either did this, just that that's what most fine tunes tend to do.
- simonw 2y agoMy test dataset is mostly dumb prompts about pelicans. You'll note that I didn't quote their benchmarks in my own post at all, because I didn't want to boost them without feeling confident in what they were stating. I posted about this because my own very limited initial experiments passed a loose vibe check! I'm impressed any time a 1.7GB (or 130MB) model file appears to be able to do anything useful at all.