5 ms·
How can I possibly know which models have gamed the MTEB benchmark and which haven't? It's very hard to know which embedding models are objectively good now th
by FL33TW00D 3y ago
How can I possibly know which models have gamed the MTEB benchmark and which haven't?
It's very hard to know which embedding models are objectively good now that everyone is gaming the benchmark.
- ramoz 3y agoTest with your own use case. Production ML means extensive custom testing suites, and even/often custom embeddings.
- jxmorris12 3y agoHow are people gaming the benchmark?