4 ms·
So Q* is just A* for neural networks?
by xg15 3y ago
So Q* is just A* for neural networks?
- deleted 3y ago[deleted]
- nsagent 3y agoI haven't heard any real details of what Q* is supposed to be; I assumed it's related to reinforcement learning. I guess it's possible the heuristic in A* was replaced with a neural network value function. I'm not sure how that could lead to a breakthrough in language models though.
- blharr 3y agoThe star in A* doesn't have anything to do with the algorithm itself. It just means optimal. Q star would mean optimal Q. If that is even what the star is referring to. There is still no way to know if the Q is the quality factor, query value, question, something else, or just a placeholder name that doesn't reference its structure at all
- deleted 3y ago[deleted]
- blharr 3y agoThere is virtually zero chance that this is what Q* is. Loosely connecting the fact that both are named with a letter and an asterisk is the only basis there is for thinking this.
- lostmsu 3y agoBeing a software engineer why else would you add a star to a known ML term?
- esafak 3y agoIt is probably A* search + Q-learning