3 ms·
Who will be the first to do a useful Instruct-trained variant? It's a pity the Mistral 7B Instruct 0.2 dataset isn't available because I've found that a much h
by nl 3y ago
Who will be the first to do a useful Instruct-trained variant?
It's a pity the Mistral 7B Instruct 0.2 dataset isn't available because I've found that a much higher quality than any of the finetunes around, and I suspect we'll have to rely on the same groups doing finetunes for this.
- bugglebeetle 3y agoNous just released their full instruction tuning dataset, so I dunno why someone with enough compute couldn’t do this.
- cosmojg 3y agoAnd Capybara be lookin' fiiine for tuning too. Seriously, though, you're right. These are some of the highest quality generative datasets in existence, and I'm surprised more isn't being done with them.
- nl 3y agoThe Nous finetunes of Mistral benchmark well but in practice seem worse than the original Mistral versions IMHO. Of course we don't know how to measure this so respect to them for the benchmark performance.