4 ms·
Without monitoring, you can definitely end up with rule-breaking behavior. I ran this experiment: https://github.com/lechmazur/emergent_collusion/ https://gith
by zone411 10mo ago
Without monitoring, you can definitely end up with rule-breaking behavior.
I ran this experiment: https://github.com/lechmazur/emergent_collusion/ https://github.com/lechmazur/emergent_collusion/. An agent running like this would break the law.
"In a simulated bidding environment, with no prompt or instruction to collude, models from every major developer repeatedly used an optional chat channel to form cartels, set price floors, and steer market outcomes for profit."
- rossant 10mo agoVery interesting. Is there any other simulation that also exhibits spontaneous illegal activity?
- zone411 10mo agoI did some searches when I posted this project, but I didn't find any at the time.
- Dilettante_ 10mo agoCooperation makes sense for how these fellas are trained. Did you ever see defection, where an agent lied about going along with a round of collusion?
- zone411 10mo agoI haven't looked in the logs for this in this particular project, but I've seen this occur frequently in my multiplayer benchmarks.