The Commodification of Attention, Distrust & Resentment: a Threat to (Rawlsian) Justice
DOI:
https://doi.org/10.71265/k6r46952Keywords:
mutual trust, stability, political liberalism, resentment, reciprocity, distrust, AI, engagement optimisation, John Rawls, JusticeAbstract
There is a growing body of scholarship on how AI technology can undermine democratic institutions. I present a novel contribution to this literature, by accounting for how and why recommendation algorithms for engagement optimisation undermine the necessary conditions for Rawlsian justice. For Rawls’s political theory, the ability to form bonds of trust with fellow citizens is a necessary condition for citizens to develop their sense of justice; and their sense of justice is a necessary condition for the attainment of justice. Recommendation algorithms amplify the space given to hateful, violent, extremist, false, and discriminatory content, I argue. This content undermines the development of mutual trust between citizens necessary for a sense of justice. If citizens can only trust their like-minded members and have a distrust of their fellow citizens, then the possibility for Rawlsian reciprocity in liberal society to be realised is not possible. Without reciprocity, liberal political systems will be inherently unstable, as citizens would not have formed the adequate affectionate ties needed for mutual cooperation, which is a precondition for a just society.
Downloads
References
Amnesty International, ‘Surveillance Giants: How the Business Model of Google and Facebook Threatens Human Rights’ (2019) https://www.amnesty.org/en/documents/pol30/1404/2019/en/ accessed 24 July 2024
Aral S, The Hype Machine: How Social Media Disrupts Our Elections, Our Economy, and Our Health—and How We Must Adapt (Crown Publishing Group 2020)
Bail CA and others, ‘Exposure to Opposing Views on Social Media Can Increase Political Polarization’ (2018) 115(37) Proceedings of the National Academy of Sciences 9216 https://doi.org/10.1073/pnas.1804840115
Balkin JM, ‘The Cycle of Polarization’ in The Cycles of Constitutional Time (Oxford University Press 2020) 187–211
Barman D, Guo Z and Conlan O, ‘The Dark Side of Language Models: Exploring the Potential of LLMs in Multimedia Disinformation Generation and Dissemination’ (2024) Machine Learning with Applications 100545
Benton P and Schmidt MW, ‘The Harm of Social Media to Public Reason’ (2024) 43 Topoi 1433
Berger J and Milkman KL, ‘What Makes Online Content Viral?’ (2012) 49 Journal of Marketing Research 192
Bhuiyan J, ‘Google Refuses to Reinstate Man’s Account After He Took Medical Images of Son’s Groin’ The Guardian (22 August 2022) https://www.theguardian.com/technology/2022/aug/22/google-csam-account-blocked accessed July 2024
Bozdag E and van den Hoven J, ‘Breaking the Filter Bubble: Democracy and Design’ (2015) 17(4) Ethics and Information Technology 249
Chiao V and Harel A, ‘Content Moderation Online: Regulation Ex Ante versus Ex Post’ (2023) University of Illinois Law Review 1587
Coeckelbergh M, Why AI Undermines Democracy and What To Do About It (John Wiley & Sons 2024)
Coeckelbergh M, ‘Democracy, Epistemic Agency, and AI: Political Epistemology in Times of Artificial Intelligence’ (2023) 3(4) AI and Ethics 1341
Cohen J and Fung A, ‘Democracy and the Digital Public Sphere’ in Lucy Bernholz, Helene Landemore and Rob Reich (eds), Digital Technology and Democratic Theory (University of Chicago Press 2021) 23
Dzihic V, ‘The Far-Right in the Western Balkans: How the Extreme Right Is Threatening Democracy in the Region’ https://www.ssoar.info/ssoar/handle/document/85191 accessed 3 June 2024
El-Bermawy MM, ‘Your Filter Bubble Is Destroying Democracy’ Wired (18 November 2016) https://www.wired.com/2016/11/filter-bubble-destroying-democracy/ accessed 24 August 2023
Furman K, ‘Epistemic Bunkers’ (2023) 37 Social Epistemology 197
Gorbach J, ‘Not Your Grandpa’s Hoax: A Comparative History of Fake News’ (2018) 35 American Journalism 236
Gunn HK, ‘Filter Bubbles, Echo Chambers, Online Communities’ in The Routledge Handbook of Political Epistemology (Routledge 2021)
Hawley J, The Tyranny of Big Tech (Simon and Schuster 2021)
Hochschild AR, Strangers in Their Own Land: Anger And Mourning on the American Right (The New Press 2016)
Igben H and Acchugbue OE, ‘Influence of Viral Contents on the Rapid Spread of Information on the Social Media Platforms in Nigeria’ (2024) 12(6) British Journal of Marketing Studies 24
Introna L and Nissenbaum H, ‘Shaping the Web: Why the Politics of Search Engines Matters’ (2000) 16 The Information Society 169
Jackson S, ‘Schema of Right-Wing Extremism in the United States’ (2022) (International Centre for Counter-Terrorism)
Kinkead D and Douglas DM, ‘The Network and the Demos: Big Data & the Epistemic Justifications of Democracy’ in Macnish K and Galliott J (eds), Big Data and Democracy (Edinburgh University Press 2020) 114–131
Lackey J, ‘Echo Chambers, Fake News, and Social Epistemology’ in Bernecker S, Flowerree AK and Grundmann T (eds), The Epistemology of Fake News (Oxford University Press 2021) 206
Leerssen P, ‘An End to Shadow Banning? Transparency Rights in the Digital Services Act Between Content Moderation and Curation’ (2023) 48 Computer Law & Security Review 105790
Macedo S, ‘Liberal Civic Education and Religious Fundamentalism: The Case of God v. John Rawls?’ (1995) 105 Ethics 468
Mahan WB, ‘The Right and The Good in Theory and Practice’ (1924) 34(1) The Monist 112
McCarty N, Polarization: What Everyone Needs to Know (Oxford University Press 2019)
McCarty N, ‘In Defense of DW-NOMINATE’ (2016) 30(2) Studies in American Political Development 172
McCarty N and Poole KT, ‘An Empirical Spatial Model of Congressional Campaigns’ (1998) 7 Political Analysis 1
Miller B and Record I, ‘Justified Belief in a Digital Age: On the Epistemic Implications of Secret Internet Technologies’ (2013) 10 Episteme 117
Mozert v. Hawkins County Bd. of Education, 827 F.2d 1058 (6th Cir. 1987)
Muirhead R and Rosenblum NL, A Lot of People Are Saying: The New Conspiracism and the Assault on Democracy (Princeton University Press 2019)
Nahon K and Hemsley J, Going Viral (Polity 2013)
Narayanan A, ‘Understanding Social Media Recommendation Algorithms’ (Knight First Amendment Institute, 9 March 2023) https://knightcolumbia.org/content/understanding-social-media-recommendation-algorithms accessed 24 July 2024
Nguyen CT, ‘Echo Chambers and Epistemic Bubbles’ (2020) 17 Episteme 141, 144
Nussbaum MC, The Monarchy of Fear: A Philosopher Looks at Our Political Crisis (Simon & Schuster 2018)
Pariser E, The Filter Bubble: How the New Personalized Web Is Changing What We Read and How We Think (Penguin Publishing Group 2012)
Posetti J and Matthews A, ‘A Short Guide to the History of “Fake News” and Disinformation’ (International Center for Journalists, July 2018) https://www.icfj.org/news/short-guide-history-fake-news-and-disinformation-new-icfj-learning-module accessed 24 August 2023
Quong J, Liberalism without Perfection (Oxford University Press 2011)
Rawls J, Justice as Fairness: A Restatement (Harvard University Press 2001)
Rawls J, Political Liberalism: Expanded Edition (Columbia University Press 2005)
Rawls J, ‘The Sense of Justice’ (1963) 72 The Philosophical Review 281
Scheffler S, ‘The Rawlsian Diagnosis of Donald Trump’ Boston Review (2019) https://www.bostonreview.net/articles/samuel-scheffler-rawlsian-diagnosis-donald-trump/ accessed 3 June 2024
Singer MT and Lalich J, Cults in Our Midst: The Hidden Menace in Our Everyday Lives (Jossey-Bass 1995)
Smith C, ‘Automating Intellectual Freedom: Artificial Intelligence, Bias, and the Information Landscape’ (2022) 48 IFLA Journal 422
Spencer DR, The Yellow Journalism: The Press and America's Emergence as a World Power (Northwestern University Press 2007)
Talisse RB, ‘Problems of Polarization’ in de Ridder J, Hannon M and Fricker M (eds), Political Epistemology (Routledge 2021) 209–226
Tanesini A, ‘The Politics of Resentment: Hope, Mistrust, and Polarization’ in Samaržija H and Cassam Q (eds), The Epistemology of Democracy (Routledge 2023) 115–134
van der Linden S, Foolproof: Why Misinformation Infects Our Minds and How to Build Immunity (WW Norton & Company 2023)
Walker MU, Moral Repair: Reconstructing Moral Relations after Wrongdoing (Cambridge University Press 2006)
Weithman P, ‘Comment: Reciprocity and the Rise of Populism’ (2020) 26 Res Publica 423
Whittaker J and others, ‘Recommender Systems and the Amplification of Extremist Content’ (2021) Internet Policy Review https://policyreview.info/articles/analysis/recommender-systems-and-amplification-extremist-content accessed 30 April 2024
Wisconsin v. Yoder, 406 U.S. 205 (1971)
Wu T, The Attention Merchants: The Epic Scramble to Get Inside Our Heads (Atlantic Books 2017)
Downloads
Published
Versions
- 15-07-2025 (3)
- 30-06-2025 (2)
- 27-06-2025 (1)
Issue
Section
License
Copyright (c) 2025 Paige Benton

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
How to Cite
Funding data
-
University of Johannesburg
Grant numbers 105591