4 ms·
> - The agent must have a good chance of competing against the opponent more than once. I was actually thinking about this the other day. I was wondering how
by kbenson 9y ago
> - The agent must have a good chance of competing against the opponent more than once.
I was actually thinking about this the other day. I was wondering how much the population size and matching algorithm in the iterated Prisoner's Dilemma matter to the strategy outcome. I suspect it's quite a lot, given that if you never play the same opponent again, strategies that defect often should come out quite well, but if you always play the same opponent, strategies that cooperate should do well. If grouping is bought into the system, such that there are multiple levels of subgroups with the smaller the group both are members in having higher chances of replaying in the same round, you might see interesting emergent behavior.
I also wonder if that might allow for special elements (the "sociopath") to have interesting divergent strategies that work well as long as they don't achieve more than a small fraction of the total population and keep a relatively large amount of interactions to strangers.
- theobon 9y agohttp://ncase.me/trust/ http://ncase.me/trust/ is a great explainer that explores that question. How do different strategies compare depending on number of repeat interactions, population diversity and noise.
- kbenson 9y agoThanks, I think someone linked to that here the other week, but I didn't have a chance to go through it at the time. It's very well done, so I'm glad you supplied the impetus to revisit it. :)
- jonahx 9y agoI really like this, but had to stop halfway through because my laptop overheated and went to sleep.
- kbenson 9y agoThat seems a bit extreme for a browser app. Are you using a docking station, and have your laptop closed? I find mine sometimes overheats and shuts down when it's docked and closed and I'm doing something extreme like playing a game, but propping the lid open about an inch or two helped immensely with airflow.
- jonahx 9y agoNo, just a 5 yo macbook pro.
- adrianratnapala 9y agoIt's not crucial that you meet the same partner (opponent) again. It's enough for you to be in a population where there is a good chance that the partner will cooperate if you do. For some definition of "good chance" the right strategy is to try to cooperate yourself and then fall back on something else if it fails. And this is interesting because it gives us a toy model of moralistic "Do unto others" (as opposed to rational exchange).
- tedsanders 9y agoCan you explain why cooperation still works when you don't repeat partners? (Assuming I've interpreted you correctly.) The reason cooperative strategies can work is that actions depend on previous actions. If you are not meeting the same partner, then your partner's actions will not depend on your previous actions, and you will always do better by defecting.
- adrianratnapala 9y agoNow that I think about it, you are right that for PD, there has to be some one-on-one iteration too. I think my automatic mental model was that agents came together and played a few rounds with one partner, and then switch to some other partner. In this case you can afford to be nice in the first round, and then cut your losses. But even that strategy is only optimal if most of the rest of the community is nice in the first round too. If it is full of defectors, then you should defect in the first round too.
- neilwilson 9y agoYour partners talk to each other. The problem with all economic simulations is that they assume extreme individualisation. Because that is what they want the world to be like. In reality the world is a network. Reputation matters.
- jessaustin 9y agoYes, if "sociopaths" are rare then most of their games will be against opponents who haven't played against them before. One suspects this also means that if the number of games goes up dramatically (say we move to the city and enter an occupation with lots of daily transactions), initial cooperation will decrease as sociopaths are seen more often.