3 ms·
Nous just released their full instruction tuning dataset, so I dunno why someone with enough compute couldn’t do this.
by bugglebeetle 3y ago
Nous just released their full instruction tuning dataset, so I dunno why someone with enough compute couldn’t do this.
- cosmojg 3y agoAnd Capybara be lookin' fiiine for tuning too. Seriously, though, you're right. These are some of the highest quality generative datasets in existence, and I'm surprised more isn't being done with them.
- nl 3y agoThe Nous finetunes of Mistral benchmark well but in practice seem worse than the original Mistral versions IMHO. Of course we don't know how to measure this so respect to them for the benchmark performance.