The Commodification of Attention, Distrust & Resentment: a Threat to (Rawlsian) Justice

Authors

DOI:

https://doi.org/10.71265/k6r46952

Keywords:

mutual trust, stability, political liberalism, resentment, reciprocity, distrust, AI, engagement optimisation, John Rawls, Justice

Abstract

There is a growing body of scholarship on how AI technology can undermine democratic institutions. I present a novel contribution to this literature, by accounting for how and why recommendation algorithms for engagement optimisation undermine the necessary conditions for Rawlsian justice. For Rawls’s political theory, the ability to form bonds of trust with fellow citizens is a necessary condition for citizens to develop their sense of justice; and their sense of justice is a necessary condition for the attainment of justice. Recommendation algorithms amplify the space given to hateful, violent, extremist, false, and discriminatory content, I argue. This content undermines the development of mutual trust between citizens necessary for a sense of justice. If citizens can only trust their like-minded members and have a distrust of their fellow citizens, then the possibility for Rawlsian reciprocity in liberal society to be realised is not possible. Without reciprocity, liberal political systems will be inherently unstable, as citizens would not have formed the adequate affectionate ties needed for mutual cooperation, which is a precondition for a just society.

Downloads

Download data is not yet available.

References

Amnesty International, ‘Surveillance Giants: How the Business Model of Google and Facebook Threatens Human Rights’ (2019) https://www.amnesty.org/en/documents/pol30/1404/2019/en/ accessed 24 July 2024

Aral S, The Hype Machine: How Social Media Disrupts Our Elections, Our Economy, and Our Health—and How We Must Adapt (Crown Publishing Group 2020)

Bail CA and others, ‘Exposure to Opposing Views on Social Media Can Increase Political Polarization’ (2018) 115(37) Proceedings of the National Academy of Sciences 9216 https://doi.org/10.1073/pnas.1804840115

Balkin JM, ‘The Cycle of Polarization’ in The Cycles of Constitutional Time (Oxford University Press 2020) 187–211

Barman D, Guo Z and Conlan O, ‘The Dark Side of Language Models: Exploring the Potential of LLMs in Multimedia Disinformation Generation and Dissemination’ (2024) Machine Learning with Applications 100545

Benton P and Schmidt MW, ‘The Harm of Social Media to Public Reason’ (2024) 43 Topoi 1433

Berger J and Milkman KL, ‘What Makes Online Content Viral?’ (2012) 49 Journal of Marketing Research 192

Bhuiyan J, ‘Google Refuses to Reinstate Man’s Account After He Took Medical Images of Son’s Groin’ The Guardian (22 August 2022) https://www.theguardian.com/technology/2022/aug/22/google-csam-account-blocked accessed July 2024

Bozdag E and van den Hoven J, ‘Breaking the Filter Bubble: Democracy and Design’ (2015) 17(4) Ethics and Information Technology 249

Chiao V and Harel A, ‘Content Moderation Online: Regulation Ex Ante versus Ex Post’ (2023) University of Illinois Law Review 1587

Coeckelbergh M, Why AI Undermines Democracy and What To Do About It (John Wiley & Sons 2024)

Coeckelbergh M, ‘Democracy, Epistemic Agency, and AI: Political Epistemology in Times of Artificial Intelligence’ (2023) 3(4) AI and Ethics 1341

Cohen J and Fung A, ‘Democracy and the Digital Public Sphere’ in Lucy Bernholz, Helene Landemore and Rob Reich (eds), Digital Technology and Democratic Theory (University of Chicago Press 2021) 23

Dzihic V, ‘The Far-Right in the Western Balkans: How the Extreme Right Is Threatening Democracy in the Region’ https://www.ssoar.info/ssoar/handle/document/85191 accessed 3 June 2024

El-Bermawy MM, ‘Your Filter Bubble Is Destroying Democracy’ Wired (18 November 2016) https://www.wired.com/2016/11/filter-bubble-destroying-democracy/ accessed 24 August 2023

Furman K, ‘Epistemic Bunkers’ (2023) 37 Social Epistemology 197

Gorbach J, ‘Not Your Grandpa’s Hoax: A Comparative History of Fake News’ (2018) 35 American Journalism 236

Gunn HK, ‘Filter Bubbles, Echo Chambers, Online Communities’ in The Routledge Handbook of Political Epistemology (Routledge 2021)

Hawley J, The Tyranny of Big Tech (Simon and Schuster 2021)

Hochschild AR, Strangers in Their Own Land: Anger And Mourning on the American Right (The New Press 2016)

Igben H and Acchugbue OE, ‘Influence of Viral Contents on the Rapid Spread of Information on the Social Media Platforms in Nigeria’ (2024) 12(6) British Journal of Marketing Studies 24

Introna L and Nissenbaum H, ‘Shaping the Web: Why the Politics of Search Engines Matters’ (2000) 16 The Information Society 169

Jackson S, ‘Schema of Right-Wing Extremism in the United States’ (2022) (International Centre for Counter-Terrorism)

Kinkead D and Douglas DM, ‘The Network and the Demos: Big Data & the Epistemic Justifications of Democracy’ in Macnish K and Galliott J (eds), Big Data and Democracy (Edinburgh University Press 2020) 114–131

Lackey J, ‘Echo Chambers, Fake News, and Social Epistemology’ in Bernecker S, Flowerree AK and Grundmann T (eds), The Epistemology of Fake News (Oxford University Press 2021) 206

Leerssen P, ‘An End to Shadow Banning? Transparency Rights in the Digital Services Act Between Content Moderation and Curation’ (2023) 48 Computer Law & Security Review 105790

Macedo S, ‘Liberal Civic Education and Religious Fundamentalism: The Case of God v. John Rawls?’ (1995) 105 Ethics 468

Mahan WB, ‘The Right and The Good in Theory and Practice’ (1924) 34(1) The Monist 112

McCarty N, Polarization: What Everyone Needs to Know (Oxford University Press 2019)

McCarty N, ‘In Defense of DW-NOMINATE’ (2016) 30(2) Studies in American Political Development 172

McCarty N and Poole KT, ‘An Empirical Spatial Model of Congressional Campaigns’ (1998) 7 Political Analysis 1

Miller B and Record I, ‘Justified Belief in a Digital Age: On the Epistemic Implications of Secret Internet Technologies’ (2013) 10 Episteme 117

Mozert v. Hawkins County Bd. of Education, 827 F.2d 1058 (6th Cir. 1987)

Muirhead R and Rosenblum NL, A Lot of People Are Saying: The New Conspiracism and the Assault on Democracy (Princeton University Press 2019)

Nahon K and Hemsley J, Going Viral (Polity 2013)

Narayanan A, ‘Understanding Social Media Recommendation Algorithms’ (Knight First Amendment Institute, 9 March 2023) https://knightcolumbia.org/content/understanding-social-media-recommendation-algorithms accessed 24 July 2024

Nguyen CT, ‘Echo Chambers and Epistemic Bubbles’ (2020) 17 Episteme 141, 144

Nussbaum MC, The Monarchy of Fear: A Philosopher Looks at Our Political Crisis (Simon & Schuster 2018)

Pariser E, The Filter Bubble: How the New Personalized Web Is Changing What We Read and How We Think (Penguin Publishing Group 2012)

Posetti J and Matthews A, ‘A Short Guide to the History of “Fake News” and Disinformation’ (International Center for Journalists, July 2018) https://www.icfj.org/news/short-guide-history-fake-news-and-disinformation-new-icfj-learning-module accessed 24 August 2023

Quong J, Liberalism without Perfection (Oxford University Press 2011)

Rawls J, Justice as Fairness: A Restatement (Harvard University Press 2001)

Rawls J, Political Liberalism: Expanded Edition (Columbia University Press 2005)

Rawls J, ‘The Sense of Justice’ (1963) 72 The Philosophical Review 281

Scheffler S, ‘The Rawlsian Diagnosis of Donald Trump’ Boston Review (2019) https://www.bostonreview.net/articles/samuel-scheffler-rawlsian-diagnosis-donald-trump/ accessed 3 June 2024

Singer MT and Lalich J, Cults in Our Midst: The Hidden Menace in Our Everyday Lives (Jossey-Bass 1995)

Smith C, ‘Automating Intellectual Freedom: Artificial Intelligence, Bias, and the Information Landscape’ (2022) 48 IFLA Journal 422

Spencer DR, The Yellow Journalism: The Press and America's Emergence as a World Power (Northwestern University Press 2007)

Talisse RB, ‘Problems of Polarization’ in de Ridder J, Hannon M and Fricker M (eds), Political Epistemology (Routledge 2021) 209–226

Tanesini A, ‘The Politics of Resentment: Hope, Mistrust, and Polarization’ in Samaržija H and Cassam Q (eds), The Epistemology of Democracy (Routledge 2023) 115–134

van der Linden S, Foolproof: Why Misinformation Infects Our Minds and How to Build Immunity (WW Norton & Company 2023)

Walker MU, Moral Repair: Reconstructing Moral Relations after Wrongdoing (Cambridge University Press 2006)

Weithman P, ‘Comment: Reciprocity and the Rise of Populism’ (2020) 26 Res Publica 423

Whittaker J and others, ‘Recommender Systems and the Amplification of Extremist Content’ (2021) Internet Policy Review https://policyreview.info/articles/analysis/recommender-systems-and-amplification-extremist-content accessed 30 April 2024

Wisconsin v. Yoder, 406 U.S. 205 (1971)

Wu T, The Attention Merchants: The Epic Scramble to Get Inside Our Heads (Atlantic Books 2017)

Downloads

Published

27-06-2025 — Updated on 15-07-2025

Versions

Issue

Section

Special Issue: TILTing 2024

How to Cite

Benton, P. (2025). The Commodification of Attention, Distrust & Resentment: a Threat to (Rawlsian) Justice. Technology and Regulation, 2025, 232-246. https://doi.org/10.71265/k6r46952 (Original work published 2025)

Funding data