3 ms·
While we're all wildly speculating about what Q* is and if GPT-5 will be able to do grade-school maths, I stumbled upon this interesting paper that discusses mi
by CGamesPlay 3y ago
While we're all wildly speculating about what Q* is and if GPT-5 will be able to do grade-school maths, I stumbled upon this interesting paper that discusses mixing classic RL algorithms (MCTS, like from AlphaGo), with LLMs. Q* is typically used to refer to the search for the optimal policy in these algorithms.
Paper: "Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation " - https://arxiv.org/abs/2311.04254 https://arxiv.org/abs/2311.04254
- luke-stanley 3y agoGreat observation on the meaning of Q*. Maybe they had a breakthrough based on similar technology? I thought of 'Everything of Thoughts' - XoT too but I presumed it's a bit more than XoT since that's public knowledge research by Microsoft Research? I saw a good thread on XoT here: https://twitter.com/IntuitMachine/status/1724455405806346374 https://twitter.com/IntuitMachine/status/1724455405806346374 There is still a big difference between human neurons and what Transformers do I believe. Humans can be more shallow and deep at the same time in such an emotional, goal directed way. The rich emotional feedback loops we have are quite different but maybe XoT could contribute to a major breakthrough in achieving AGI, with a more straightforward approach that sidesteps complex emotions. I'm sure there are quite a few ways to go about it. Just some intuitions.