4 ms·

Can you provide some links to where Ken Regan describes how to do it?

by zodiac 11y ago

beefman 11y ago
You just run multi-PV analysis and play moves to keep the intrinsic performance rating[1][2] at the desired level. [1] http://www.cse.buffalo.edu/~regan/papers/pdf/ReHa11c.pdf http://www.cse.buffalo.edu/~regan/papers/pdf/ReHa11c.pdf [2] http://www.cse.buffalo.edu/~regan/papers/pdf/Reg12IPRs.pdf http://www.cse.buffalo.edu/~regan/papers/pdf/Reg12IPRs.pdf
- sanderjd 11y ago
  Thanks for the awesome links! > You just run multi-PV analysis and play moves to keep the intrinsic performance rating at the desired level. I thought that "just" was funny – it reminds me of this comic[0]. [0]: http://howfuckedismydatabase.com/nosql/fault-tolerance.png http://howfuckedismydatabase.com/nosql/fault-tolerance.png
  - beefman 11y ago
    It just means analyzing more than one move at a time. Any engine supporting the UCI protocol should be able to do it. Like Stockfish, which is free.[1] So you don't need to create a new engine to implement this feature. It might be possible to implement it with a bash script. Certainly with JS.[2] Stockfish does have a "skill level" setting, and it's not terrible at faking club-level play (if you have the Play Magnus mobile app, it's just Stockfish at different skill levels). However, as of 2013 the implementation is much more primitive than what I'm suggesting here.[3] To be clear, even though it's incredibly obvious, I've never seen this idea anywhere else. It first occurred to me after reading the original Guid & Bratko paper on intrinsic ratings in 2006. Happy to continue this offlist if you want to work on it. My e-mail is in my profile. [1] http://support.stockfishchess.org/kb/advanced-topics/uci-protocol http://support.stockfishchess.org/kb/advanced-topics/uci-pro... [2] https://www.npmjs.com/package/stockfish https://www.npmjs.com/package/stockfish [3] https://groups.google.com/forum/#!msg/fishcooking/4Q6BQyHeRJQ/eu63qkOyWUkJ https://groups.google.com/forum/#!msg/fishcooking/4Q6BQyHeRJ...
    - sanderjd 11y ago
      I actually understood what you meant, I just think it's funny when we use "just" right before saying something that seems complex (even if it isn't actually all that complex). Having said that, I only added the link to that comic because I didn't want to just write a comment saying "thanks for the links", and I'm only replying again, because I'm hoping it continues the pattern where you keep replying to my replies with super interesting links!
- dfan 11y ago
  You can successfully make a computer program play at a 2000 FIDE level (say), in that its win/loss/draw results will be consistent with that of a 2000 FIDE human. IPR is a good way of doing this in a quantitative way. The interesting problem is to make the computer play like a 2000-rated person, not just as well as a 2000-rated person. I'm a big fan of Regan's work, but I don't think IPR on its own is sufficient to make the computer play idiomatic suboptimal moves.

Can you provide some links to where Ken Regan describes how to do it?

by zodiac 11y ago

Can you provide some links to where Ken Regan describes how to do it?

You just run multi-PV analysis and play moves to keep the intrinsic performance rating[1][2] at the desired level. [1] http://www.cse.buffalo.edu/~regan/papers/pdf/ReHa11c.pdf http://www.cse.buffalo.edu/~regan/papers/pdf/ReHa11c.pdf [2] http://www.cse.buffalo.edu/~regan/papers/pdf/Reg12IPRs.pdf http://www.cse.buffalo.edu/~regan/papers/pdf/Reg12IPRs.pdf

sanderjd 11y ago
Thanks for the awesome links! > You just run multi-PV analysis and play moves to keep the intrinsic performance rating at the desired level. I thought that "just" was funny – it reminds me of this comic[0]. [0]: http://howfuckedismydatabase.com/nosql/fault-tolerance.png http://howfuckedismydatabase.com/nosql/fault-tolerance.png
- beefman 11y ago
  It just means analyzing more than one move at a time. Any engine supporting the UCI protocol should be able to do it. Like Stockfish, which is free.[1] So you don't need to create a new engine to implement this feature. It might be possible to implement it with a bash script. Certainly with JS.[2] Stockfish does have a "skill level" setting, and it's not terrible at faking club-level play (if you have the Play Magnus mobile app, it's just Stockfish at different skill levels). However, as of 2013 the implementation is much more primitive than what I'm suggesting here.[3] To be clear, even though it's incredibly obvious, I've never seen this idea anywhere else. It first occurred to me after reading the original Guid & Bratko paper on intrinsic ratings in 2006. Happy to continue this offlist if you want to work on it. My e-mail is in my profile. [1] http://support.stockfishchess.org/kb/advanced-topics/uci-protocol http://support.stockfishchess.org/kb/advanced-topics/uci-pro... [2] https://www.npmjs.com/package/stockfish https://www.npmjs.com/package/stockfish [3] https://groups.google.com/forum/#!msg/fishcooking/4Q6BQyHeRJQ/eu63qkOyWUkJ https://groups.google.com/forum/#!msg/fishcooking/4Q6BQyHeRJ...
  - sanderjd 11y ago
    I actually understood what you meant, I just think it's funny when we use "just" right before saying something that seems complex (even if it isn't actually all that complex). Having said that, I only added the link to that comic because I didn't want to just write a comment saying "thanks for the links", and I'm only replying again, because I'm hoping it continues the pattern where you keep replying to my replies with super interesting links!
dfan 11y ago
You can successfully make a computer program play at a 2000 FIDE level (say), in that its win/loss/draw results will be consistent with that of a 2000 FIDE human. IPR is a good way of doing this in a quantitative way. The interesting problem is to make the computer play like a 2000-rated person, not just as well as a 2000-rated person. I'm a big fan of Regan's work, but I don't think IPR on its own is sufficient to make the computer play idiomatic suboptimal moves.