4 ms·
never rhe less, why arent we making even FASTER progress on formal domains? Where is the alphazero moment for LLMs + search? Either the reward space is truell
by algo_trader 4y ago
never rhe less, why arent we making even FASTER progress on formal domains?
Where is the alphazero moment for LLMs + search?
Either the reward space is truelly sparse. Or maybe the dataset of existing formulas is actually quite small?
- visarga 4y agoYes, reward space is sparse, they need to train on human demonstrations (same with the recent Minecraft model) to bootstrap more meaningful exploration.
- gwern 4y agoThe AlphaZero for LLMs+search is GPT-f, which most recently did https://openai.com/blog/formal-math/ https://openai.com/blog/formal-math/