3 ms·

Looks like they utilized the Bradley-Terry model, but that's not one I'm super familiar with. https://en.wikipedia.org/wiki/Bradley%E2%80%93Terry_model https:/

• huac 3y ago
  the BTL model is just a way to infer 'true' skill levels given some list of head to head comparisons. the head to head comparisons / rankings are the most important!!!! and in this case, the rankings come from GPT-4 itself. so take any subsequent score with all the grains of salt you can muster. their methodology also appears to be 'try 12 different models and hope 1 of them wins out.' multiple hypothesis adjustments come to mind here :)