Excited to share just how good Mixtral is. It outperformed GPT-4 in the boolean classification test. However, I should say these benchmarks are not meant to be

Excited to share just how good Mixtral is. It outperformed GPT-4 in the boolean classification test. However, I should say these benchmarks are not meant to be academically meaningful. My testing was strictly done on my real world use cases. I didn’t start with the intention to do these tests, but in working on my personal project I realized I could convert my integration tests to output test results. I performed these tests using a 3090 and llama.cpp.