3 ms·
I disagree with this. Reinforcement learning with verifiable rewards training is actually the secret sauce that is leading Claude and GPT to automating software
by LarsDu88 5mo ago
I disagree with this. Reinforcement learning with verifiable rewards training is actually the secret sauce that is leading Claude and GPT to automating software engineering tasks.
All the easily verifiable domains such as mathematics, coding, and things that can be run inside a reasonable simulation are falling very very fast.
By next year if not sooner, mathematicians will be wildly outpaced by LLMs for reasoning.
- deleted 5mo ago[deleted]
- Alex_L_Wood 5mo agoCoding is anything but “easily” verifiable.
- LarsDu88 5mo agoIt's extremely verifiable. The reinforcement finetuning strategy I'm referring to involves LLM creating coding tasks with an expected output, implementing the code, and then having a compiler (or interpreter in the case of languages like python) succeed or fail to run the code. Then compare the output to expected output. The verification process (run interpreter + run test) can be done in seconds. One can generate millions of datasets like this for free and there is extensive research showing with the right policy, an agent will be able to learn to reason - first as good as human, and in many cases superior to a human.
- throwaway27448 5mo ago> It's extremely verifiable. Only if you fully detail the behavior of the system.... at that point why use a chatbot? You've coded the entire thing. > first as good as human We'll see. Chatbots are only as capable as you detail them to be
- Alex_L_Wood 5mo agoFor basic primitives with known output it’s verifiable, but as long as you’re dealing with real systems with tons of inputs and side effects this no longer holds true. > research showing with the right policy, Rest of the owl.