3 ms·
> At the highest reasoning effort for both systems, Astra for Law passed the evaluation’s overall correctness check on 54.0% of questions isn't that kind of po
by sirnicolaz 8d ago
> At the highest reasoning effort for both systems, Astra for Law passed the evaluation’s overall correctness check on 54.0% of questions
isn't that kind of poor?
- alansaber 8d agoYes, it is. If they had built a specialised tool for a practice area, they could have improved it significantly- but they don't want to be THAT involved.