Soft incentive mechanism design

Markets, cakes, karma, and reverse game theory, applied to humans

September 22, 2014 — July 9, 2024

bounded compute
economics
faster pussycat
game theory
incentive mechanisms
institutions
networks

Mechanism design for the imperfect moral wetware of human beings. In practice, that means we might relax some of the mathematical axiomatization and consider more qualitative/fuzzy ways of thinking about it that are more “inspired by” formal algorithmic/game-theoretic models than presuming exactness. What do our rarefied abstract models of mechanisms imply for societies at large?

Figure 1: A mechanism incentivising coordination.

“Reverse” game theory, bargaining, auctions, pie slicing, swarm sensing for autonomous agents. Reputation mechanisms. Voting systems are mechanisms. The classic controversial one, assassination markets, are no longer at the vanguard. Prediction markets are a classic incentive mechanism for distributing forecasts (Merchant 2020). Every blockchain-style cryptowhatsit is a mechanism design problem. More important for this notebook, better governance can benefit from mechanism design.

One might frame adversarial learning as mechanism design.

It is worth knowing the concepts of mechanism design. It seems like the alternative to explicit mechanism design is bad implicit mechanism design.

1 Performance targets

Harder than we imagine. See Goodhart’s law.

2 Iterative conversation games

See iterated conversation games.

3 Voting systems

Democracy is the soft mechanism built upon the hard mechanism of, among other things, voting systems.

4 Selling a mechanism to laypeople

Sometimes, I notice that for many people thinking about how we might design incentive systems seems to be taboo. I suspect that this is because making things morally wrong is part of how human brains internalize collective action problems.

Observationally, I can get more buy-in to a conversation about mechanism talking about “fair systems” without talking about “incentives”, I think because if we talk about incentives it sounds like we might be bribing people, or encouraging greed. Sometimes we surely are doing that. I find this latter type of fuzziness uncomfortably disingenuous, but if the outcome is the same, maybe it’s OK.

5 Examples

  • Choron is a case study in designing a mechanism for handling house chores.

6 Incoming

  • Hamilton Nolan, Everyone Into The Grinder

    An interesting statement of a mechanism design problem.

    One of the most direct ways to improve a flawed system is simply to end the ability of rich and powerful people to exclude themselves from it. If, for example, you outlawed private schools, the public schools would get better. They would get better not because every child deserves to have a quality education, but rather because it would be the only way for rich and powerful people to ensure that their children were going to good schools The theory of “a rising tide lifts all boats” does not work when you allow the people with the most influence to buy their way out of the water. It would be nice if we fixed broken systems simply because they are broken. In practice, governments are generally happy to ignore broken things if they do not affect people with enough power to make the government listen. So the more people that we push into public systems, the better.

    I would like to make the thesis there a little more precise, but there is something there.

  • Facebook will change algorithm to demote “borderline content” that almost violates policies

  • Dàzéxiāng Qǐyì is the name of the perverse incentive uprising during the Qin dynasty

    Chen Sheng and Wu Guang were both army officers who were ordered to lead their bands of commoner soldiers north to participate in the defence of Yuyang (simplified Chinese: 渔阳; traditional Chinese: 漁陽). However, they were stopped halfway in present-day Anhui province by flooding from a severe rainstorm. The harsh Qin laws mandated execution for those who showed up late for government jobs, regardless of the nature of the delay. Figuring that they would rather fight than accept execution, Chen and Wu organised a band of 900 villagers to rebel against the government.

  • Measurement and power in organisations (which mentions the Hubbard book on measurement) (Hubbard 2014). Great book, by the way; see analytics

7 References

Akerlof. 1970. The Market for ‘Lemons’: Quality Uncertainty and the Market Mechanism.” The Quarterly Journal of Economics.
Arthur. 1994. “Inductive Reasoning and Bounded Rationality: The El Farol Problem.” American Economic Review.
———. 1995. “Complexity in Economic and Financial Markets.” Complexity.
Atanasov, Rescober, Stone, et al. 2015. Distilling the Wisdom of Crowds: Prediction Markets Versus Prediction Polls.” Academy of Management Proceedings.
Aziz, Bouveret, Caragiannis, et al. 2018. Knowledge, Fairness, and Social Constraints.” Proceedings of the AAAI Conference on Artificial Intelligence.
Aziz, and Brandl. 2012. Existence of Stability in Hedonic Coalition Formation Games.”
Aziz, Brandl, Brandt, et al. 2018. On the Tradeoff Between Efficiency and Strategyproofness.” Games and Economic Behavior.
Aziz, Brandt, and Harrenstein. 2013. Pareto Optimality in Coalition Formation.” In Games and Economic Behavior.
Aziz, Caragiannis, Igarashi, et al. 2021. Fair Allocation of Combinations of Indivisible Goods and Chores.”
Aziz, and de Keijzer. 2011. Complexity of Coalition Structure Generation.”
Aziz, and Rey. 2019. Almost Group Envy-Free Allocation of Indivisible Goods and Chores.”
Berg. 2003. “Normative Behavioral Economics.” The Journal of Socio-Economics.
Bernheim. 2002. “Taxation and Saving.” In Handbook of Public Economics.
Bhattacharya, and Packalen. 2020. Stagnation and Scientific Incentives.” Working Paper 26752.
Boutilier, Caragiannis, Haber, et al. 2015. Optimal Social Choice Functions: A Utilitarian View.” Artificial Intelligence.
Bowles, and Gintis. 1998. “Efficient Redistribution: New Rules for Markets, States and Communities.” Recasting Egalitarianism: New Rules for Communities, States and Markets.
Brandt, and Bullinger. 2022. Finding and Recognizing Popular Coalition Structures.” Journal of Artificial Intelligence Research.
Buchanan. 1954. Social Choice, Democracy, and Free Markets.” Journal of Political Economy.
Buterin, Hitzig, and Weyl. 2019. A Flexible Design for Funding Public Goods.” Management Science.
Caragiannis, Nath, Procaccia, et al. 2017. Subset Selection Via Implicit Utilitarian Voting.” Journal of Artificial Intelligence Research.
Challet, Marsili, and Zhang. 2000. “Modeling Market Mechanism with Minority Game.” Physica A: Statistical and Theoretical Physics.
Easley, and Kleinberg. 2010. Networks, Crowds, and Markets: Reasoning about a Highly Connected World.
Gasparyan, Gerasimov, Voronov, et al. 2015. Rewarding Peer Reviewers: Maintaining the Integrity of Science Communication.” Journal of Korean Medical Science.
George. 2009. Preference Pollution: How Markets Create the Desires We Dislike.
Gintis. 2010. “The Dynamics of Generalized Market Exchange.”
Graham-Tomasi, Runge, and Hyde. 1986. Foresight and Expectations in Models of Natural Resource Markets.” Land Economics.
Grossman, and Stiglitz. 1980. On the Impossibility of Informationally Efficient Markets.” The American Economic Review.
Hubbard. 2014. How to Measure Anything: Finding the Value of Intangibles in Business.
Hudson, Botzen, Czajkowski, et al. 2014. “Risk Selection and Moral Hazard in Natural Disaster Insurance Markets: Empirical Evidence from Germany and the United States.”
Jackall. 2009. Moral Mazes: The World of Corporate Managers.
Jan. 2018. Recognition and Reward System for Peer-Reviewers.” In CEUR Workshop Proceedings.
Lo. 2004. The Adaptive Markets Hypothesis.” The Journal of Portfolio Management.
Louzoun, Solomon, Goldenberg, et al. 2003. World-Size Global Markets Lead to Economic Instability.” Artificial Life.
Maital. 1986. Prometheus Rebound: On Welfare-Improving Constraints.” Eastern Economic Journal.
Mann, and Helbing. 2016. Minorities Report: Optimal Incentives for Collective Intelligence.” arXiv:1611.03899 [Cs, Math, Stat].
Merchant. 2020. Click Here to Kill.” Harper’s Magazine.
Merrifield, and Saari. 2009. Telescope Time Without Tears: A Distributed Approach to Peer Review.” Astronomy & Geophysics.
Nordhaus. 2005. Schumpeterian Profits and the Alchemist Fallacy.” SSRN Scholarly Paper ID 820309.
Offer. 2002. Why Has the Public Sector Grown so Large in Market Societies? The Political Economy of Prudence in the UK, c. 1870-2000. Working Paper 44. Oxford Economic and Social History Working Papers.
Padgett, and Powell. 2012. The Emergence of Organizations and Markets.
Paich, and Sterman. 1993. Boom, Bust, and Failures to Learn in Experimental Markets.” Management Science.
Procaccia, Shah, and Zick. 2016. Voting Rules as Error-Correcting Codes.” Artificial Intelligence.
Shah. 2022. Challenges, Experiments, and Computational Solutions in Peer Review.” Communications of the ACM.
Simon. 1991. Organizations and Markets.” The Journal of Economic Perspectives.
Spence. 2002. Signaling in Retrospect and the Informational Structure of Markets.” American Economic Review.
Su. 1999. Rental Harmony: Sperner’s Lemma in Fair Division.” The American Mathematical Monthly.
Sun. 2014. To Divide the Rent, Start With a Triangle.” The New York Times.
Sutton. 2001. Technology and Market Structure: Theory and History.
The Economist. 2019. Can Technology Plan Economies and Destroy Democracy?
Valentine, Retelny, To, et al. 2017. Flash Organizations: Crowdsourcing Complex Work by Structuring Crowds As Organizations.” In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems.
Viljoen, Goldenfein, and McGuigan. 2021. Design Choices: Mechanism Design and Platform Capitalism.” Big Data & Society.
Weyl. 2017. The Robustness of Quadratic Voting.” Public Choice.
Xiao, Dörfler, and van der Schaar. 2014. Incentive Design in Peer Review: Rating and Repeated Endogenous Matching.” arXiv:1411.2139 [Cs].
Xu, Zhao, and Shi. 2017. “Mechanism Design for Paper Review.”