Prisoner's dilemma illustrates how individual rationality can lead to collectively worse outcomes
Image: David McSpadden from Daly City, United States, CC BY 2.0, via Wikimedia Commons
Prisoner's dilemma illustrates how individual rationality can lead to collectively worse outcomes
The prisoner's dilemma showcases the paradox where two rational agents choosing to defect results in a worse collective outcome compared to mutual cooperation. This paradox highlights the conflict between individual rationality and collective well-being.
Example
In a classic scenario, if both prisoners betray each other, they each receive a moderate sentence. However, if they had both cooperated, they would have received lighter sentences.
Remember this
Understanding this paradox is crucial for designing systems and policies that encourage cooperation and improve collective outcomes.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
mechanism design does: designs rules so rational agents produce desired outcomes
Mechanism design constructs rules for desired outcomes
the revelation principle says: any mechanism can be converted to a truthful one
Tragedy of the commons leads to resource depletion
a dominant strategy is: optimal regardless of what other players do
A dominant strategy maximizes payoff irrespective of opponents' actions
the minimax theorem says: in zero-sum games, there's a saddle point strategy
Minimax theorem guarantees a saddle point strategy in zero-sum games
Reinforcement learning from human feedback
RLHF optimizes a reward model trained on human preference pairs
DPO simplifies: removes the explicit reward model, trains directly on preferences
DeFi removes intermediaries like banks
Swipe through 100 ML concepts daily
Open Pocket Polymath