3 ms·
I think I could. Few or none of the new samples even manage to maintain coherency in a sample, and you can see all sorts of garbage prose being generated.
by gwern 7y ago
I think I could. Few or none of the new samples even manage to maintain coherency in a sample, and you can see all sorts of garbage prose being generated.
- YeGoblynQueenne 7y agoPerhaps you could. Personally, I think it's impossible to get an accurate comparison in this way.
- gwern 7y agoI think it is possible, because it turns out I am right: the quality is much lower when compared directly on perplexity as well: https://medium.com/@NPCollapse/addendum-evaluation-of-my-model-e6734b51a830 https://medium.com/@NPCollapse/addendum-evaluation-of-my-mod...