3 ms·
Kudos: > SimpleQA was created to be a greater challenge for frontier models (e.g., GPT-4o scores less than 40%).
by kaonwarb 2y ago
Kudos:
> SimpleQA was created to be a greater challenge for frontier models (e.g., GPT-4o scores less than 40%).
- jampekka 2y agoAnd by design: "To be included in the dataset, each question had to meet a strict set of criteria: ... and most questions had to induce hallucinations from either GPT-4o or GPT-3.5."