3 ms·
"Greenblatt" shown with 42% in the bar chart is GPT-4o with a strategy: https://substack.com/@ryangreenblatt/p-145731248 https://substack.com/@ryangreenblatt/p-
by Stevvo 2y ago
"Greenblatt" shown with 42% in the bar chart is GPT-4o with a strategy: https://substack.com/@ryangreenblatt/p-145731248 https://substack.com/@ryangreenblatt/p-145731248
So, how well might o1 do with Greenblatt's strategy?
- mikeknoop 2y agoI bet pretty well! Someone should try this. It's likely expensive but sampling could give you confidence to keep going. Ryan's approach costs about $10k to run the full 400 public eval set at current 4o prices -- which is the arbitrary limit we set for the public leaderboard.