5 ms·
I've thought about how to quantify the effects of skill on a game. A first-order estimate would quantify luck as the inverse of skill. In a completely symmetri
by lmkg 13y ago
I've thought about how to quantify the effects of skill on a game. A first-order estimate would quantify luck as the inverse of skill.
In a completely symmetric multiplayer game, Player A is measurably more skilled than Player B if, over a large number of games, Player A's win rate is higher than 50% by a statistically significant margin. This definition can be extended to both single-player games, and to non-symmetric multiplayer games, by saying that after Player A and Player B have played the same scenario a large number of times, that Player A's win rate is higher than Player B's by a statistically significant margin. The "same scenario" meaning identical starting conditions for single-player, or the same opponents for multi-player. This can be extended again by saying "the same scenario" means drawing starting conditions or opponents from the same random distribution (by relying on the nature of statistical significance).
So that's how you would define pairwise player skill. From this, there are several ways to determine total rankings for a population of players, using Elo or linear algebra techniques. I'm eliding details here because this is the step where they matter the least.
Finally, in order to determine the impact of Luck vs Skill: Take two players at different skill levels. Say, Player X is at the median skill level, and Player Y is two standard deviations above that (top 5%). What is Player Y's win rate over Player X? The closer to 100%, the more skill-based the game is. The closer to 50%, the more luck-based the game is.
Note that in general this will depend heavily on which two skill levels you pick to compare. For example, Player X is median, Player Y is top 5%, Player Z is top 1%. Players Y & Z could have a 100% win rate over Player X, but Player Z only has a 51% win rate over Player Y. This game would probably be described as heavily skill-based, but with a low skill ceiling.