26 ms·
No limit: AI poker bot is first to beat professionals at multiplayer game
- pesenti 7y agoBlog post: https://ai.facebook.com/blog/pluribus-first-ai-to-beat-pros-in-6-player-poker/ https://ai.facebook.com/blog/pluribus-first-ai-to-beat-pros-... Science article: https://science.sciencemag.org/content/early/2019/07/10/science.aay2400 https://science.sciencemag.org/content/early/2019/07/10/scie...
- samfriedman 7y agoThe FB post is much more detailed and I think the link on this post should be updated to point there.
- YeGoblynQueenne 7y ago>> Pluribus is also unusual because it costs far less to train and run than other recent AI systems for benchmark games. Some experts in the field have worried that future AI research will be dominated by large teams with access to millions of dollars in computing resources. We believe Pluribus is powerful evidence that novel approaches that require only modest resources can drive cutting-edge AI research. That's the best part in all of this. I'm not convinced by the claim the authors repeatedly make, that this technique will translate well to real-world problems. But I'm hoping that there is going to be more of this kind of result, singalling a shift away from Big Data and huge compute and towards well-designed and efficient algorithms. In fact, I kind of expect it. The harder it gets to do the kind of machine learning that only large groups like DeepMind and OpenAI can do, the more smaller teams will push the other way and find ways to keep making progress cheaply and efficiently.
- kqr 7y agoYes! I work for a company that does just this: pull big gears on limited data and try to generalise across groups of things to get intelligent results even on small data. In many ways, it absolutely feels like the future.
- mooneater 7y agoInteresting, are you using bayesian methods?
- kqr 7y agoDoes "Bayesian methods" mean anything specific? Parts of the core algorithms were written before I joined, and they are very improvised in the dog-in-a-lab-coat way. I haven't analysed them to see how closely they follow Bayes theorem and how strictly they define conjugate probabilities etc. (we are also heavily using simple empirical distributions), but the general idea of updating priors with new evidence is what it builds on, yes. I have a hard time imagining doing things any other way and still getting quality results, but that is probably a reflection on my shortcomings rather than a technical fact.
- r00fus 7y agoI was really hoping the article would go into more detail on how the AI engaged with the human players. Was it online? the picture on the article seems to imply IRL. If IRL, what inputs did it have, simply cards shown or could it read tells? Did those players know they were playing an AI?
- noambrown 7y agoIt was online. The players were playing from home on their own schedules. The bot did not look at any tells (timing tells or otherwise). The players knew they were playing a bot and knew which player the bot was.
- deleted 7y ago[deleted]
- cortesoft 7y agoTells aren't really a thing for top level poker players.
- merlincorey 7y agoPretty incredible that this has scaled down from 100 CPUs (and a couple terabytes of RAM) for their two player limit hold'em bot to just two CPUs for the no limit bot.
- neural_thing 7y agoHow long until a slightly worse version of this model is reverse engineered and appears at every table in online poker?
- ehsankia 7y agoThis is something I've always wondered, how come bots haven't taken over online poker considering how much money there is to be made, and all you need is to be slightly better than average right? Is high level poker really that hard to achieve?
- friendlybus 7y agoPost blizerian's time in poker, the human players in online games use statistics to make insane bets on odds. They play many many games at once and just look for the opening and make the insane bets when the openings come up. They've done the math that it's worth it to do those kinds of bets.
- csa 7y agoI did this with great success. For reference, I once folded top boat to quads (he showed) to a river all in raise in PLO to a dude who had a 100% win showdown when raise river stat over several thousand hands. Other stats confirmed he was a nit, so it was an easy fold. Iirc, this was PLO 200 or PLO 400 — I never saw anyone that nitty at the PLO 1000 or PLO 2000 tables. FWIW, I did a lot more than “look for an opening”, although I did a lot of that. I tried to play GTO as much as possible, but I would adjust to people who were exploitable when they called too much, folded too much, or were too aggressive into weakness. I spent a lot of time away from the table analyzing stats of the regulars to find leaks to exploit. It was worth the time, and it made it much easier to play 8-12 tables of PLO.
- dbancajas 7y agodo you still play online? I used to railbird FT back then, watching patrick antonius/sahamies/durr/jungleman etc. exciting times. How many hours did you put in for you to be good?
- noambrown 7y agoI'm one of the authors of the bot, AMA
- eries 7y agoCan you share some about what strategies the bot prefers and how these compare with common professional human strategies?
- noambrown 7y agoWe talk about this a bit in the paper. Based on the feedback from the pros, the bot seems to "donk bet" (call and then bet on the next round) much more than human pros do. It also randomizes between multiple bet sizes, including very large bet sizes, while humans stick to just one or two sizes depending on the situation.
- MFLoon 7y agoWhen human players donk bet it's almost always a weak player employing an extremely exploitable strategy, whereas pros almost never do it because the metagame has evolved around the presumption that nobody ever donk bets. I'd love to see what the bot's balanced GTO donking strategy looks like.
- newfangle 7y agoDonk bets exist in the meta, ie when the turn is extremely good for your range but is horrible for your opponent. ( if you have a fd on the flop and it hits on the turn you can overbet the pot on the turn with your bluffs and foushes then just go all in on the river) if they have top pair its pretty hard to play against that
- MFLoon 7y agoOh, sure. I more meant flop donk bets; I guess it doesn't specify which street the donking was happening.
- cklaus 7y agoIs the source code and data available for allowing others to play against this not?
- JaRail 7y agoSo let me see if I understand this. I don't believe it's hard to write a probabilistic program to play poker. That's enough to win against humans in 2-player. With one AI and multiple professional human players sitting at a physical table, the humans outperform the probabilistic model because they take advantage of each other's mistakes/styles. Some players crash out faster but the winner gets ahead of the safe probabilistic style of play. So this bot is better at the current professional player meta than the current players. In a 1v1 against a probabilistic model, it would probably also lose? Am I understanding this properly? Or is playing the probabilistic model directly enough of a tell that it's also losing strategy? Meaning you need some variation of strategies, strategy detection, or knowledge of the meta to win?
- rightbyte 7y agoInteresting article. Too bad a don't have a subscription to read the paper. The bot played like 10 000 hands. There is no way that is enough to prove it's better or worse than the opponents. More so in no-limit where some key all-ins can turn the game up side down. The variance is higher than limit or fixed, right? I did a heads up Texas holdem fixed bot with "counter factual regret minimization" like 8 years ago from a paper I read. It had to play like 100 000 hands vs a crappy reference bot to prove it was better. Strategy detection in so short games is probably worthless. The edge is probably in seeing who are tired or drunk in paper poker.
- junar 7y agoThey mention that they use AIVAT to reduce variance. > Although poker is a game of skill, there is an extremely large luck component as well. It is common for top professionals to lose money even over the course of 10,000 hands of poker simply because of bad luck. To reduce the role of luck, we used a version of the AIVAT[1] variance reduction algorithm, which applies a baseline estimate of the value of each situation to reduce variance while still keeping the samples unbiased. For example, if the bot is dealt a really strong hand, AIVAT will subtract a baseline value from its winnings to counter the good luck. This adjustment allowed us to achieve statistically significant results with roughly 10x fewer hands than would normally be needed. [1] https://arxiv.org/abs/1612.06915 https://arxiv.org/abs/1612.06915
- deleted 7y ago[deleted]
- zzo38computer 7y agoI have seen fixed limit AI, and here is now no limit AI. Is there a pot limit AI?
- auggierose 7y agoThis is fascinating stuff. So do I understand this right, Liberatus worked using computing the Nash equilibrium, while the new multiplayer version works using self-play like AlphaGo Zero? Did you run the multiplayer version against the two-player version? If yes, how did it go? Could you recommend a series of books / papers that can take me from zero to being able to reprogram this (I know programming and mathematics, but not much statistics)? And how much computing resources / time did it take to train your bot?
- noambrown 7y agoTraining was super cheap. It would cost under $150 on cloud computing services. The training aspect has some improvements but is at its core similar to Libratus. The search algorithm is the biggest difference. There aren't that many great resources out there for helping new people get caught up to speed on this area. That's something we hope to fix in the future. Maybe this would be a good place to start? http://modelai.gettysburg.edu/2013/cfr/cfr.pdf http://modelai.gettysburg.edu/2013/cfr/cfr.pdf
- dharma1 7y agoIs Oskari Tammelin still working on this stuff? I remember he wrote some very fast CFR optimisations a few years ago
- auggierose 7y agoWould you say it would be hard to expand this to tables with 9 players?
- noambrown 7y agoNo, it wouldn't be hard. We chose six players because it's the most common/popular form of poker. Also, as you add more players it becomes harder and harder to evaluate because the bot's involved in fewer hands, we need to have more pros at the table, and we need to coordinate more schedules. Six was logistically pretty tough already.
- indigodaddy 7y agoWas this cash or tourney format? How many blinds deep was the bot and the rest of the players at the start?
- GCA10 7y agoFrom the sample hands, it looks as if it's a cash game with stacks equal to 200BB. Plenty of room to play real poker.
- alexashka 7y agoThe title is misleading - bots have been beating no limit pros in 1v1 matches for quite some time. This is for 6-man games. The article mentions 10,000 hands - this is a very small sample size to draw any real conclusions, as anyone who has dabbled in online poker for more than a few thousand dollars can attest to. Regardless - it's trivial to write a bot that'll beat 90% of the players, as site runners can all attest to (bots are a serious problem that is not new). What does it matter that a bot can beat 'the best' or 'professionals'? It's enough that it can do better than the vast majority, outside of dystopian woes about robots taking over or being 'superior' to human beings. Glossing over all that - I am curious if this can be used for something other than ruining online poker, which has largely already been ruined by allowing multi-tabling professionals with custom software that gathers statistics on players (data mining), existing bots, US government and irresponsible (criminal) site runners (looking at you ultimate bet)
- ayemeng 7y agoCurious, why was 100BB used for six max? If I recall right, the head ups experiment was 200BB?
- bokonon12 7y agoGuessing it's because it's most similar to a regular 6max game. Also it should limit lower the number of possible ways to play a hand, less chips means the correct choices are easier, so maybe it's computationally easier
- ayemeng 7y agoYeah, my question for the author is if stack depth was relevant for this experiment. In headups, they exhausted the entire tree, in six max, they went to a fixed depth.
- noambrown 7y agoWe considered both options but decided to go with 100BB because that is the standard in the poker world. It doesn't make a big difference for these techniques though.
- ayemeng 7y agoDoes Pluribus care about opponent's stack depth? From the examples, it appears stacks were reset after each hand.
- srkigo 7y agoCould you try to run a training with ante included in the pot? I wonder if open-limping would be a viable strategy with some hands. No one knows that and it would be really interesting to find out. Ante should be equal to BB, like it was in WSOP Main Event.
- gringoDan 7y agoCurious if we'll see human poker pros get much better in the coming years as they incorporate training regimens that involve bots (analogous to chess today vs. 50 years ago). Seems like this will be the trend in almost every game.
- TylerE 7y agoAs someone who plays both games....I doubt it. Poker is an incomplete information game with crushingly high variance. The bots strategy is likely not quantifiable.
- gringoDan 7y agoCan you expand on this? I'm a novice at both games, but the Facebook blog post mentioned that the bot exhibited some unconventional strategies: > Pluribus disagrees with the folk wisdom that donk betting (starting a round by betting when one ended the previous betting round with a call) is a mistake; Pluribus does this far more often than professional humans do. Is it overly simplistic to think that humans could improve their game by incorporating some strategies like this more/less often than they were previously?
- TheChosenZygote 7y agoBots have already influenced the poker meta. Libratus showed us how it was optimal to sometimes overbet bluff when you have nut blocker(s). I'm sure when these poker pros do hand reviews, they're not looking at how they can exploit Pluribus, but moreso how they can incorporate some of the lines/strategies it used to beat everyone else.
- asdfman123 7y agoSo, is this the end of online poker? Will it just become increasingly sophisticated bots playing each other online?
- trishume 7y agoI'm really confused about why stock for the company that makes PokerStars hasn't moved at all today: https://www.google.com/search?tbm=fin&q=TSE:+TSGI#scso=_wqsnXbuWBu2N_QbshojgBw2:0 https://www.google.com/search?tbm=fin&q=TSE:+TSGI#scso=_wqsn... The fact that there's a published recipe for a superhuman bot that can be trained for $150 and run on any desktop computer sounds like an existential threat to their business. The main mitigating factor I can think of is that you'd need to also adversarially train it so it isn't distinguishable from a skilled human. But that doesn't seem like it would be too difficult.
- asdfman123 7y agoYou know, now that we're talking about it I'm wondering if someone hasn't already come up with a better bot and has just been silently using it to win money online. I'm sure the sites have been crawling with bots as long as they've been around, some better than others. As long as it doesn't drive away too many customers I doubt the sites care. They still take a rake on bot games. However better AI could change that as the "dumb money" slowly dries up.
- vannevar 7y agoWhat would stop the sites themselves from operating those bots? They wouldn't even need AI, just deal favorable "cards" to their own player.
- bcassedy 7y agoDumb money has been drying up for years. There have been bots taking millions of dollars out of games for more than a decade. Even bots from 10 years ago were sophisticated enough to win money at mid-stakes poker (up to $2000 buy in 6max no limit games)
- GCA10 7y agoHi Noam: I'm intrigued that you trained/tested the bot against strategies that were skewed to raise a lot, fold a lot and check a lot, as well as something resembling GTO. Were there any kinds of table situations where the bot had a harder time making money? Or where the AI crushed it? I'm thinking in particular of unbalanced tables with an ever-changing mixture of TAG and LAG play. I've changed my mind three times about whether that's humans' best refuge -- or a situation that's a bot's dream. You've done the work. Insights welcome.
- luckyalog 7y agoisnt it just possible that the bot got lucky. It plays good. Maybe really good but does it play as good as a pro??? Would it win 9 wp bracelets. Would It make it to day 3 of the world series of poker. Chris Moneymaker got some damn good hands. Its part of the game. Its why this feat is unremarkable and why poker is a crap game for AI. The outcomes are very loose, especially when the reason these guys are pros is partially because of their ability to read. You are taking away a tool that made their proker players great and then expect them to be a metric to test the AI. A better test would be to have pro players play a set of 1, 2, 4, 7 basic rule bots and the AI does the same. Then you compare differences in play. With enough data points you can compare situations that are similar but the AI did better or worse. This is a fair comparison of skill. Also if there are professional players at a multiplayer game the AI is getting help from other players. Just like Civ V I get help from the AI attacking itself. Im sure this AI got help from the players attacking eachother (especially if they were doing so and making the pot bigger for the AI to grab up, think of a player reraising another player after the bot does a check all in).
- vecter 7y ago"In a 12-day session with more than 10,000 hands, it beat 15 top human players." That's not luck. See also: https://news.ycombinator.com/item?id=20416099 https://news.ycombinator.com/item?id=20416099 Also, Chris Moneymaker is a good poker player. He's no Phil Ivey or Tom Dwan, but he's still very good and has had decent results after his WSOP win.
- awal2 7y agoDespite the luck/noise in Poker, there are reasonable measures of performance, and while I'm not an expert in this area, the bot seems to be doing very well (see paper for details). Poker is not a "crap game for AI" it's actually quite a good game. It's a very simple example of a game with a lot of randomness (a feature not a bug) and hidden information that still admits a wide variety of skill levels (expert play is much better than intermediate play is much better than novice play). This is a great accomplishment. More links for reference: https://ai.facebook.com/blog/pluribus-first-ai-to-beat-pros-in-6-player-poker/ https://ai.facebook.com/blog/pluribus-first-ai-to-beat-pros-... https://science.sciencemag.org/content/early/2019/07/10/science.aay2400 https://science.sciencemag.org/content/early/2019/07/10/scie...
- w_s_l 7y agoI would love to get a hands on the source. Hook it up to an API like https://pokr.live https://pokr.live and then basically build a computer vision poker bot. The trick is how to create natural mouse click movements or keyboard inputs. This is the part that I'm most shaky on but the pokr.live API works by sending screenshots which it will translate into player actions at the table disclaimer: pokr.live API is a WIP
- auggierose 7y agoYou do that by letting a human play, informed by the bot.
- david-gpu 7y agoTime to cross poker off the list? [0] https://xkcd.com/1002/ https://xkcd.com/1002/
- cyberferret 7y agoWith the advent of AI bots in Poker, Chess etc., what happens to the old adage of "Play the player, not the game". How do modern human players manage when you don't have the psychological aspects of the game to work with? I see on chess channels that grand masters have to rethink their whole game preparation methodology to cope with the "Alpha Zero" oddities that have now been introduced into this ancient game. They literally have to "throw out the book" of standard openings and middle games and start afresh.
- pk2200 7y agoThe chess channels you're visiting are grossly overstating Alpha Zero's impact. AFAICT, it hasn't made any impact on opening theory at all. AZ's strength is in the middlegame, where it appears to be slightly better than traditional engines (like Stockfish) at finding material sacrifices for long term piece activity and/or mating attacks.
- friedman23 7y ago> what happens to the old adage of "Play the player, not the game". How do modern human players manage when you don't have the psychological aspects of the game to work with? I would say that it's thoroughly rebounded to play the game not the player in poker and this isn't because of super bots like the one used in this paper. Ever since game theory invaded poker players that play in highly visible events such as tv tournaments try as hard as possible to make their game unexploitable.
- yelloworld 7y agoLike already stated, saying that Alpha Zero has forced the chess world to seriously reconsider the basic principles of chess openings etc. is a bit of a stretch. But interestingly enough, the current world champion (Magnus Carlsen) is having the chess streak of his life as we speak. On the side, he's been openly joking about Alpha Zero being one of his biggest chess idols. It's safe to say the streak is probably mostly related to his preparation from the last world championship match half a year ago carrying over to all the tournaments after. However, even according to the former world champion (Viswanathan Anand) the run he's been on is something quite shocking: “His results this year is simply [great].... difficult to find words. [It’s been] completely off the charts. I think the chess world is still in a bit of a shock. The rest of the players are struggling to deal with a phenomenon [like him]. Even in 2012-13, his domination was less than it is this year. Everyone is still processing this information.” [1] Carlsen is basically on route to breaking 2900 Elo - at 2882 Elo with a clear upwards trend - while there's only two other active players even above 2800 Elo and struggling to keep it above that treshold. (Elo is the rating system used in chess. Above 1500 Elo is an average player, 2000 Elo is a good player, 2500 Elo is a grandmaster. Anything above 2700 Elo is basically godlike.) Oddly enough, instead of playing more like a machine, it seems like Carlsen has been playing chess that is much more about the human aspect of the game rather than trying to find the top ranked engine move on every turn. (The current traditional top engine - Stockfish - makes an assumption of each move's validity using a point system, which the chess world has been more or less obsessing over for the past decade. Alpha Zero doesn't have such a point system whatsoever.) He's been playing a drastically more aggressive and dynamic variety of chess compared to what has been seen in a long time at the top tournaments. He's been playing to create dizzying positions on the board, making a few moves that aren't necessarily liked by the traditional top engines, but still finding himself in a winning position several moves after. It definitely looks like some sort of black magic, but it seems like the big thing Alpha Zero has brought to the general philosophy on how to approach chess at the top level is that it's possible to play aggressive chess, take risks and win in 2019. Magnus Carlsen is the first player to successfully reinvent that style of play, more than likely partly inspired by Alpha Zero. So, I'd say the big thing about Alpha Zero isn't necessarily that it could beat the other top engines, but more importantly that the 'artistic' aspect of its play is something that has never been seen from another chess engine. The fact that it proved that sort of style superior to the play ever before played by another chess engine is just the icing on the cake. Garry Kasparov on Alpha Zero's chess persona: "I admit that I was pleased to see that AlphaZero had a dynamic, open style like my own. The conventional wisdom was that machines would approach perfection with endless dry maneuvering, usually leading to drawn games. But in my observation, AlphaZero prioritizes piece activity over material, preferring positions that to my eye looked risky and aggressive." [2] [1] https://sportstar.thehindu.com/chess/viswanathan-anand-on-magnus-carlsen-phenomenon-chess-world/article28382375.ece# https://sportstar.thehindu.com/chess/viswanathan-anand-on-ma... [2] https://science.sciencemag.org/content/362/6419/1087 https://science.sciencemag.org/content/362/6419/1087
- grandtour001 7y agoWere the games played with real money? Nobody is going to take fake money games seriously.
- zwendkos 7y agoThis is the most important question.
- slashcom 7y agoFrom the paper: "$50,000 was divided among the human participants based on their performance to incentivize them to play their best. Each player was guaranteed a minimum of $0.40 per hand for participating, but this could increase to as much as $1.60 per hand based on performance." So the humans weren't betting their own money, but they still made more money if they won.
- deleted 7y ago[deleted]
- solidasparagus 7y agoSo Dota 2 doesn't count as a multiplayer game? OpenAI Five beat the world champions in back-to-back games...
- elefanten 7y agoAgreed, the "first multiplayer" claim needs some walking back or caveats. Cool achievement, but hollow marketing doesn't make it better.
- filoleg 7y agoMy guess is that by "multiplayer", they meant "free for all", as opposed to "N vs. N". In other words, multiple opposing factions.
- taejavu 7y agoYes, Dota 2 is not a multiplayer poker game. I agree that the title is ambiguous, but it's not a stretch to imagine that "poker" is implied here.
- solidasparagus 7y agoI don't think it's implied considering the articles compares the poker bot to go and chess bots (which are the non-multiplayer games the title is referring to).
- noambrown 7y agoFrom an AI and game theory standpoint, there isn't much difference between two-team zero-sum and two-player zero-sum if the teammates are trained together. That said, the Dota 2 work is extremely impressive for a variety of other reasons.
- solidasparagus 7y agoThere is far more ambiguity when you are competing against five mostly-aligned strategies vs a single shared strategy.
- anbop 7y agoWould love to wire this into some kind of device I could play with at a casino.
- gexla 7y agoIt's easy to "take away" too much information from this. The focus is that an AI poker bot "did this" and not get too much into other adjacent subjects. But what's the fun in that? 10,000 hands in an interesting number. If you search the poker forums, you'll see this is the number you'll see people throw out there for how many hands you need to see before you can analyze your play. You then make adjustments and see another 10,000 hands before you can assess those changes. In 2019, it's impractical to adapt as a competitive player in live poker. A grinder can see 10,000 hands within a day. The live poker room took 12 days. Another characteristic of online poker is that players can also use data to their advantage. So, I wouldn't consider 10K hands as long term, even if this was a period of 12 days. Once players get a chance to adapt, then they'll increase their rate of wins against a bot. Once you have a history of hand histories being shared, then it's all over. And again, give these players their own software tools. Remember that one of the most exciting events in online poker was the run of isildur1. That run was put to rest when he went bust against players who had studied thousands of his hand histories. This doesn't take away from the development of the bot. If we learn something from it, then all good.
- csa 7y agoYou clearly didn’t read the additional links they posted. They mentioned why they chose 10k (AIVAT), and it goes far beyond any of the variables you mentioned. For any number of hands, my money is on the bot.
- Traster 7y agoThat really doesn't address the point that was raised. It's not that the bot wins through luck and that 10k is too small a sample, it's that a good professional poker player isn't good over 10k hands, they're good over 5 years. Any good player will have their play analyzed and responded to, so there's a feedback loop there - any good player will have their play analyzed, exploited and will have to re-adjust their strategy to respond to exploitative play. The question is: How does the AI strategy adapt over time to players who know the hand history of the AI strategy. That's an extremely important part of being a top level player. To give you an example - if you watch Daniel Negreanu's vlog about his time at the WSOP he actively talks about changing his strategy in response to his analysis of different players' profiles. This is especially important in Sit & Go where at high stakes you'll have regular grinders who build up reputations - less so in tournaments where you're less likely to meet any given player.
- DeathArrow 7y agoI wonder what would be the impact of using Counterfactual Regret Minimization instead of training a neural network based on hands played by real players? Whys is using CFR better than training based on real data?
- Tenoke 7y agoIt's not necesserily better but with CFR you can learn beyond what humans have learned, but on the other hand you dont learn their usual mistakes to more easily exploit them. Also in this approach you need CRM since at every point you are checking what would've happened if you picked something else, which is just impossible with a fixed dataset.
- DeathArrow 7y agoI was thinking a year ago about using Deep Reinforcement Learning in a poker bot what stopped me was the impossible amount of data and computation due to imperfect information nature of poker games. If I'll have the time I'll try to implement thing akin to the search technique described in the paper. It might pay better than a full time job.
- thomasfl 7y agoOne of the researchers, Tuomas Sundholm, has a real badass CV. Former pilot in the Finnish airforce. Finnish windsurfer champion. Snowboarder. Professor at Carnegie Mellon. Speaks four european languages, including swedish. And now at the age of 51, he has created the best AI powered poker bot. https://www.cs.cmu.edu/~sandholm/cv.pdf https://www.cs.cmu.edu/~sandholm/cv.pdf
- sakarisson 7y ago> Speaks four european languages, including swedish. Judging by his name, I'd assume Swedish is his first language, so that particular aspect isn't that surprising to me
- krageon 7y agoJust from the fact that he exists in Finland and is older than 20 it's basically a given that he speaks Swedish because they learn it in school.
- estomagordo 7y agoThat's stretching it a bit. Many Fins only speak very basic Swedish.
- Dragory 7y agoLearning it in school and actually speaking it are very different things though. Source: learned Swedish in school in Finland, rarely used it since, have practically forgotten all about it now.
- xxs 7y agoFinland has two official languages - Swedish and Finnish, his name suggests he is Swedish to begin with. It's not uncommon to speak four languages (often C2 in couple of them) in the North Europe, esp. the Baltic region. Like mentioned by sibling (sakarisson), that particular part is not impressive, the rest - sure
- jacquesm 7y ago
- IloveHN84 7y agoBasically, all the online Poker rooms are now rigged and leading to frauds
- axilmar 7y ago"At each decision point, it compares the state of the game with its blueprint and searches a few moves ahead to see how the action played out. It then decides whether it can improve on it." That's exactly how the brain operates.
- rofo1 7y agoI'd love to see high-stakes heads-up bot vs Tom Dwan or Negreanu. Maybe a bot technically qualifies as an opponent in durrr's challenge [0]? :) How would bluffing influence the outcome? Both these players who are considered very strong, are known to play all kinds of hands. [0] - https://en.wikipedia.org/wiki/Tom_Dwan#Full_Tilt_Poker_Durrrr_Million_Dollar_Challenge https://en.wikipedia.org/wiki/Tom_Dwan#Full_Tilt_Poker_Durrr...
- Anecdotal 7y agoPoker is a game about adapting, therefore a poker pro could study the bot's gameplay and adapt enough in order to beat it, then in turn the bot could do the same thing.
- donk2019 7y agoCongrats Noam for the great breakthrough work! I have a question about the conspiracy. For the 5 Human + 1 AI setting, since the human pros know which player is AI (read from your previous response), is it possible for human players to conspire to beat the AI?
- donk2019 7y agoCongrats Noam for the great breakthrough work! I have a question about the conspiracy. For the 5 Human + 1 AI setting, since the human pros know which player is AI (read from your previous response), is it possible for human players to conspire to beat the AI? And in theory, for multi-player game, even the AI plays at the best strategy, is it still possible to be beat by conspiracy of other players? Thanks.
- nishantvyas 7y agoI don't get this... Poker isn't pure mathematical... it has emotions involved (greed, fear, belief, reading others, manipulations (to fool the opponent)... and may be more... and all of these emotions arises differently for different people based on their time, place, their world view, their background and history...) Are we now saying that a computer can do this all in simulation? if so, it's a great break through in human history.
- throwamay1241 7y agoAt the nosebleeds, poker hasn't been around those things in a long time. Poker is about exploitative play against people who base their play off emotions, and unperfect game theory optimal against players who don't base their play off emotions. The more perfect the GTO play is, the higher the winrate against the latter group, but higher stakes games are built around one or more bad players - pros will literally stop playing as soon as the fish busts.
- User23 7y agoThe most interesting thing about this to me is the lesson it teaches human players about bluffing.