3 ms·
The benchmarks are pretty impressive, but the release of a fixed MT-Bench and the Physics GRE exams is a very nice touch https://github.com/InflectionAI/Inflect
by RandUCBUGrad 3y ago
The benchmarks are pretty impressive, but the release of a fixed MT-Bench and the Physics GRE exams is a very nice touch https://github.com/InflectionAI/Inflection-Benchmarks https://github.com/InflectionAI/Inflection-Benchmarks.
I tried asking the Pi model some questions and it has gotten much, much better since I last tried it a few months ago. Night and day.
- zone411 3y agoThey really should have an API available. It's difficult to get a good idea of the quality of their model otherwise. For example, I just created a benchmark based on NYT Connections, and I don't mind paying for access and I'd love to add Inflection, but having to jump through hoops with Selenium or whatever seems so unnecessary.