4 ms·

Do anyone know what Q* is?

• alexose 3y ago
  Is far as I can tell, this is the first time an OpenAI project called Q* has been mentioned in the news. I don't see any prior mentions on Twitter either. (I wish they'd picked a different letter, given all the Q-related conspiracy theories that we're already dealing with...)
  • inglor_cz 3y ago
    That was my impression as well. Why the hell is the difference between one of the most prominent disinformation sources out there and a promising AI project just an asterisk. First Twitter changes to X, then AI changes to Q*. What happened to multi-syllable words? They used to be quite handy. Maybe if our attention spans shorten, so does our ability to use longer words. Weird. Or, said otherwise - TL;DR: LOL, ROFL.
• sudosysgen 3y ago
  Q* is the optimal (ie, correct for the decision problem) function computing the total expected reward of taking an action from a given state in reinforcement learning.
  • NhanH 3y ago
    That is just Q. The asterisk is new
    • debugnik 3y ago
      The "star" in A* means optimal (as in actually proven to be optimal, so they could stop publishing A^[whatever] algorithms). I assume either Q* is considered optimal in a way regular Q-learning isn't, or they're mixing Q-learning with some A*-like search algorithm. (Or someone picked an undeserving name.)
    • sudosysgen 3y ago
      Depends on the notation. Sometimes Q* is used to denote optimality, for example here : https://www.cs.toronto.edu/~jlucas/teaching/csc411/lectures/lec21_22_handout.pdf https://www.cs.toronto.edu/~jlucas/teaching/csc411/lectures/... , page 31