4 ms·
From Anthropic a couple days ago too, self finetuning: https://arxiv.org/html/2506.10139v1 https://arxiv.org/html/2506.10139v1
by cma 1y ago
From Anthropic a couple days ago too, self finetuning:
https://arxiv.org/html/2506.10139v1 https://arxiv.org/html/2506.10139v1
- deleted 1y ago[deleted]
- Uninen 1y agoThis is wild! "when assessed by Claude 3.5 Sonnet’s production-grade RM, our unsupervised assistant policy wins 60% of head-to-head comparisons against the policy trained with the human-supervised RM." So now the models can even post-train the new models better than a human can
- cma 1y agoEverytop model in ARC AGI used a test time finery king approach. They they had one example pair though and would usually do transformations (color, mirroring, etc) of it for the finetuning, and that might have been coded by hand
- dang 1y agoRelated ongoing thread: Unsupervised Elicitation of Language Models - https://news.ycombinator.com/item?id=44276041 https://news.ycombinator.com/item?id=44276041