Same here. Official Mixtral & Mistral (the new v0.2) seem to have the best & most dependable output vs basically all their predecessors/derivatives of equal or

Same here. Official Mixtral & Mistral (the new v0.2) seem to have the best & most dependable output vs basically all their predecessors/derivatives of equal or smaller parameter sizes. Mixtral is on a whole other level with its baked-in 'chain of thought' reasoning. The fine tunes (e.g. dolphin-mixtral, dolphin2.2-mistral, etc) may be good at coding or whatever else they specialize in, but they seem to sacrifice in other areas that result in 'hallucinating' where Mixtral/Mistral wouldn't - perhaps as a result of 'score chasing' on benchmarks like has been mentioned already. Depends on your own specific needs & use cases whether this is important or not.