5 ms·
Overall good post, but feels like he has an axe to grind with LLMs to the point it is misleading: > Last week, DeepSeek published their new R1-Zero and R1 “rea
by usaar333 2y ago
Overall good post, but feels like he has an axe to grind with LLMs to the point it is misleading:
> Last week, DeepSeek published their new R1-Zero and R1 “reasoner” systems that is competitive with OpenAI’s o1 system on ARC-AGI-1. R1-Zero, R1, and o1 (low compute) all score around 15-20% – in contrast to GPT-4o’s 5%, the pinnacle of years of pure LLM scaling
R1-zero gets 14% on private set which is the exact same score June Sonnet got; Sonnet, not 4o, is the pinnacle of pure LLM scaling