3 ms·

All due respect - I wouldn't really consider this to be an example of anything close to approaching the subject of AI alignment - at least not in terms that peo

All due respect - I wouldn't really consider this to be an example of anything close to approaching the subject of AI alignment - at least not in terms that people talk about in the past few years. "Exhaustive short horizon exploring strategy with simple terminal heuristics" - is this in reference to the for loop which calculates the future possible states of the game up to a certain depth? It seems to be a state exploration algorithm. The number of possible game states is well-defined here. Perhaps you're conflating the subject of video game AI with concepts related to machine learning AI?

GistNoesis 6y ago
The AI is optimizing for a different goal than the player : Like a loving helicopter mom, this AI is trying its best to help you reduce tower height now (to reduce risk) whereas the human player has different objective often related to increasing its score over a certain horizon. The thing is from the programming point of view there are not a unique way to define what should be a "best move".
- ShamelessC 6y ago
  Are you responding to someone else? My issue is not with understanding the algorithm's flaws and the difficulty surrounding providing players with an optimal choice considering players have different goals than the heuristics used in the algorithm. My issue is with you using incorrect terms and conflating machine learning with a relatively simple graph based algorithm with a relatively simple heuristic. There is no machine learning going on in this codebase whatsoever as far as I can tell, but you seem to be claiming there is. Do you care to respond to that?
  - GistNoesis 5y ago
    >There is no machine learning going on in this codebase whatsoever as far as I can tell, but you seem to be claiming there is. Do you care to respond to that? Afaik I haven't coined the term "machine learning" in this thread and made no such claim. To clarify : There is no machine learning going on in this codebase (though the problem is interesting enough that you can replace the simple AI by a more advanced one). I was just merely pointing that AI alignment problem already affect even simple decision making agents.

GistNoesis 6y ago

The AI is optimizing for a different goal than the player : Like a loving helicopter mom, this AI is trying its best to help you reduce tower height now (to reduce risk) whereas the human player has different objective often related to increasing its score over a certain horizon. The thing is from the programming point of view there are not a unique way to define what should be a "best move".

ShamelessC 6y ago
Are you responding to someone else? My issue is not with understanding the algorithm's flaws and the difficulty surrounding providing players with an optimal choice considering players have different goals than the heuristics used in the algorithm. My issue is with you using incorrect terms and conflating machine learning with a relatively simple graph based algorithm with a relatively simple heuristic. There is no machine learning going on in this codebase whatsoever as far as I can tell, but you seem to be claiming there is. Do you care to respond to that?
- GistNoesis 5y ago
  >There is no machine learning going on in this codebase whatsoever as far as I can tell, but you seem to be claiming there is. Do you care to respond to that? Afaik I haven't coined the term "machine learning" in this thread and made no such claim. To clarify : There is no machine learning going on in this codebase (though the problem is interesting enough that you can replace the simple AI by a more advanced one). I was just merely pointing that AI alignment problem already affect even simple decision making agents.