3 ms·
I haven't heard any real details of what Q* is supposed to be; I assumed it's related to reinforcement learning. I guess it's possible the heuristic in A* was r
by nsagent 3y ago
I haven't heard any real details of what Q* is supposed to be; I assumed it's related to reinforcement learning. I guess it's possible the heuristic in A* was replaced with a neural network value function. I'm not sure how that could lead to a breakthrough in language models though.
- blharr 3y agoThe star in A* doesn't have anything to do with the algorithm itself. It just means optimal. Q star would mean optimal Q. If that is even what the star is referring to. There is still no way to know if the Q is the quality factor, query value, question, something else, or just a placeholder name that doesn't reference its structure at all
- deleted 3y ago[deleted]