High-risk AI transparency? On qualified transparency mandates for oversight bodies under the EU AI Act
DOI:
https://doi.org/10.71265/6bedar76Keywords:
artificial intelligence, AI Act, transparency, enforcementAbstract
The legal opacity of AI technologies has long posed challenges in addressing algorithmic harms, as secrecy enables companies to retain competitive advantages while limiting public scrutiny. In response, ideas such as qualified transparency have been proposed to provide AI accountability within the confidentiality constraints. With the introduction of the EU AI Act, the foundations for human-centric and trustworthy AI have been established. The framework sets regulatory requirements for certain AI technologies and grants oversight bodies broad transparency mandates to enforce the new rules. This paper examines these transparency mandates under the AI Act and argues that it effectively implements qualified transparency, which may potentially mitigate the problem of AI opacity. Nevertheless, several challenges remain in achieving the Act’s policy objectives.
Downloads
References
AI HLEG, ‘Ethics Guidelines for Trustworthy AI’ [2019] Communication EC <https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai>
Allcott H and others, ‘The Welfare Effects of Social Media’ (2020) 110 American Economic Review 629 <https://doi.org/10.1257/aer.20190658>
Ananny M and Crawford K, ‘Seeing without Knowing: Limitations of the Transparency Ideal and Its Application to Algorithmic Accountability’ (2018) 20 New Media & Society 973
Barocas S and Selbst AD, ‘Big Data’s Disparate Impact’ [2018] SSRN Electronic Journal
Barredo Arrieta A and others, ‘Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI’ (2020) 58 Information Fusion
Bishop CM and Bishop H, Deep Learning: Foundations and Concepts (2023)
Burrell J, ‘How the Machine “Thinks”: Understanding Opacity in Machine Learning Algorithms’ (2016) 3 Big Data & Society
Busuioc M, ‘Accountable Artificial Intelligence: Holding Algorithms to Account’ (2021) 81 Public Administration Review
Castelvecchi D, ‘Can We Open the Black Box of AI?’ (2016) 538 Nature
Crawford K and Schultz J, ‘Big Data and Due Process: Toward a Framework to Redress Predictive Privacy Harms’ (2014) 55 Boston College Law Review
de Laat PB, ‘Algorithmic Decision-Making Based on Machine Learning from Big Data: Can Transparency Restore Accountability?’ (2018) 31 Philosophy and Technology
de Vries S, Kanevskaia O and de Jager R, ‘Internal Market 3.0: The Old “New Approach” for Harmonising AI Regulation’ (2023) 2023 8 European Papers - A Journal on Law and Integration 583 <https://www.europeanpapers.eu/en/e-journal/internal-market-30-old-new-approach-harmonising-ai-regulation>
Diakopoulos N, ‘Algorithmic Accountability Reporting: On the Investigation of Black Boxes’ [2014] Tow Center for Digital Journalism
Directive 2016/943, ‘Directive 2016/943 of the European Parliament and of the Council of 8 June 2016 on the Protection of Undisclosed Know-How and Business Information (Trade Secrets) against Their Unlawful Acquisition, Use and Disclosure’
Ducato R, ‘Why Harmonised Standards Should Be Open’ (2023) 54 IIC International Review of Intellectual Property and Competition Law 1173
Ebers M and others, ‘The European Commission’s Proposal for an Artificial Intelligence Act—A Critical Assessment by Members of the Robotics and AI Law Society (RAILS)’ (2021) 4 J
Edwards L and Veale M, ‘Slave to the Algorithm? Why a Right to Explanation Is Probably Not the Remedy You Are Looking For’ [2017] SSRN Electronic Journal
Enholm IM and others, ‘Artificial Intelligence and Business Value: A Literature Review’ (2022) 24 Information Systems Frontiers
European Commission, ‘Antitrust: Commission Fines Google €2.42 Billion for Abusing Dominance as search Engine by Giving Illegal Advantage to Own Comparison Shopping - Press Release’ <https://ec.europa.eu/commission/presscorner/api/files/document/print/en/ip_17_1784/IP_17_1784_EN.pdf>
European Commission, ‘Communication: Building Trust in Human Centric Artificial Intelligence | Shaping Europe’s Digital Future’ (2018) <https://digital-strategy.ec.europa.eu/en/library/communication-building-trust-human-centric-artificial-intelligence>
European Commission, ‘Communication from the Commission on Artificial Intelligence for Europe.’ <https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52018DC0237>
European Commission, ‘White Paper on Artificial Intelligence: A European Approach to Excellence and Trust’ (2020) <https://commission.europa.eu/publications/white-paper-artificial-intelligence-european-approach-excellence-and-trust_en>
European Commission, ‘Explanatory Memorandum to the Proposal for a Regulation Laying down Harmonised Rules on Artificial Intelligence ’ <https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52021PC0206>
European Commission, ‘Impact Assessment of the Regulation on Artificial Intelligence’ (2021) <https://digital-strategy.ec.europa.eu/en/library/impact-assessment-regulation-artificial-intelligence>
European Commission, ‘Proposal for a Regulation Laying down Harmonised Rules on Artificial Intelligence’ (2021) <https://digital-strategy.ec.europa.eu/en/library/proposal-regulation-laying-down-harmonised-rules-artificial-intelligence>
European Commission, ‘AI Act | Shaping Europe’s Digital Future’ (2024) <https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai> accessed 23 October 2024
European Parliament, ‘Resolution on the Commission Evaluation Report on the Implementation of the General Data Protection Regulation Two Years after Its Application’ <https://www.europarl.europa.eu/doceo/document/TA-9-2021-0111_EN.html>
Eurostat, ‘Enterprises That Recruited or Tried to Recruit ICT Specialists by Size Class of Enterprise’ (2024) <https://ec.europa.eu/eurostat/databrowser/view/isoc_ske_itrcrs__custom_13155803/default/table?lang=en>
Foss-Solbrekk K, ‘Three Routes to Protecting AI Systems and Their Algorithms under IP Law: The Good, the Bad and the Ugly’ (2021) 16 Journal of Intellectual Property Law & Practice 247 <https://doi.org/10.1093/jiplp/jpab033>
Foss-Solbrekk K and Glenster AK, ‘The Intersection of Data Protection Rights and Trade Secret Privileges in ‘algorithmic Transparency’, Research Handbook on EU Data Protection Law (2022)
FTC, ‘Statement of the Federal Trade Commission Regarding Google’s Search Practices’ <http://www.ftc.gov/os/2001/10/gmstmtswinleary.htm.>
Galaz V and others, ‘Artificial Intelligence, Systemic Risks, and Sustainability’ (2021) 67 Technology in Society 101741
Grochowski M and others, ‘Algorithmic Transparency and Explainability for EU Consumer Protection: Unwrapping the Regulatory Premises’ (2021) 8 Critical Analysis of Law
Gstrein OJ, Haleem N and Zwitter A, ‘General-Purpose AI Regulation and the European Union AI Act’ (2024) 13 Internet Policy Review
Helberger N and Diakopoulos N, ‘ChatGPT and the AI Act’ (2023) 12 Internet Policy Review
Janiesch C, Zschech P and Heinrich K, ‘Machine Learning and Deep Learning’ (2021) 31 Electronic Markets
Kaminski ME, ‘Understanding Transparency in Algorithmic Accountability’, The Cambridge Handbook of the Law of Algorithms (Cambridge University Press 2020)
Kaminski ME, ‘Regulating the Risks of AI’ (2022) 103 Boston University Law Review 1347 <https://papers.ssrn.com/abstract=4195066>
Keles B, McCrae N and Grealish A, ‘A Systematic Review: The Influence of Social Media on Depression, Anxiety and Psychological Distress in Adolescents’ (2020) 25 International Journal of Adolescence and Youth
Kemper J and Kolkman D, ‘Transparent to Whom? No Algorithmic Accountability without a Critical Audience’ (2019) 22 Information Communication and Society 2081
Knowles B and Richards JT, ‘The Sanction of Authority: Promoting Public Trust in AI’ [2021] FAccT 2021 - Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency 262 <https://dl.acm.org/doi/10.1145/3442188.3445890>
Koulu R, ‘Crafting Digital Transparency: Implementing Legal Values into Algorithmic Design’ (2021) 8 Critical Analysis of Law
Kroll JA and others, ‘Accountable Algorithms’ (2017) 165 University of Pennsylvania Law Review
Larsson S and Heintz F, ‘Transparency in Artificial Intelligence’ (2020) 9 Internet Policy Review 1 <https://policyreview.info/concepts/transparency-artificial-intelligence>
Lu S, ‘Regulating Algorithmic Harms’ [2024] Florida Law Review
Malgieri G and Pasquale F, ‘Licensing High-Risk Artificial Intelligence: Toward Ex Ante Justification for a Disruptive Technology’ (2024) 52 Computer Law and Security Review
Menell PS, ‘Tailoring a Public Policy Exception to Trade Secret Protection’ (2017) 105 California Law Review 1
Mylly UM, ‘Transparent AI? Navigating Between Rules on Trade Secrets and Access to Information’ (2023) 54 IIC International Review of Intellectual Property and Competition Law 1013 <https://link.springer.com/article/10.1007/s40319-023-01328-5>
Novelli C and others, ‘A Robust Governance for the AI Act: AI Office, AI Board, Scientific Panel, and National Authorities’ [2024] SSRN Electronic Journal <https://papers.ssrn.com/abstract=4817755>
O’Neil C, Weapons of Math Destruction : How Big Data Increases Inequality and Threatens Democracy (2016)
Oxford Internet Institute, ‘Harmonising Artificial Intelligence’ (2021) <https://www.oii.ox.ac.uk/news-events/reports/harmonising-artificial-intelligence/>
Paolucci F, ‘Shortcomings of the AI Act - Evaluating the New Standards to Ensure the Effective Protection of Fundamental Rights’ [2024] Verfassungsblog <https://doaj.org/article/d7642fe7e81f4a849b9a602e8ff38ea2>
Pasquale F, ‘Beyond Innovation and Competition: The Need for Qualified Transparency in Internet Intermediaries’ (2010) 104 Northwestern University Law Review 105
Pasquale F, The Black Box Society : The Secret Algorithms That Control Money and Information (Harvard University Press 2015)
Rai A, ‘Explainable AI: From Black Box to Glass Box’ (2020) 48 Journal of the Academy of Marketing Science
Regulation 2016/679, ‘Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95/46/EC (General Data Protection Regulation)’ <http://data.europa.eu/eli/reg/2016/679/oj>
Regulation 2017/745, ‘Regulation (EU) 2017/745 of the European Parliament and of the Council on Medical Devices’ <http://data.europa.eu/eli/reg/2017/745/oj>
Regulation 2019/1020, ‘Regulation (EU) 2019/1020 of the European Parliament and of the Council of 20 June 2019 on Market Surveillance and Compliance of Products and Amending Directive 2004/42/EC and Regulations (EC) No 765/2008 and (EU) No 305/2011’ <http://data.europa.eu/eli/reg/2019/1020/oj>
Regulation 2024/1689, ‘Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 Laying down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act)’ <http://data.europa.eu/eli/reg/2024/1689/oj>
Ribeiro MH and others, ‘Auditing Radicalization Pathways on YouTube’, FAT* 2020 - Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (2020)
Russell S and Norvig P, Artificial Intelligence - A Modern Approach ((4th Edition), 2021)
Sandeen SK and Aplin T, ‘Trade Secrecy, Factual Secrecy and the Hype Surrounding AI’, Research Handbook on Intellectual Property and Artificial Intelligence (2022)
Sivan-Sevilla I, ‘Varieties of Enforcement Strategies Post-GDPR: A Fuzzy-Set Qualitative Comparative Analysis (FsQCA) across Data Protection Authorities’ [2022] Journal of European Public Policy
Smith P and Smith L, ‘This Season’s Artificial Intelligence (AI): Is Today’s AI Really That Different from the AI of the Past? Some Reflections and Thoughts’ [2024] AI and Ethics
Söderlund K and others, ‘Regulating High-Reach AI: On Transparency Directions in the Digital Services Act’ (2024) 13 Internet Policy Review <https://doi.org/10.14763/2024.1.1746>
Söderlund K and Larsson S, ‘Enforcement Design Patterns in EU Law: An Analysis of the AI Act’ (2024) 3 Digital Society 2024 3:2 1 <https://link.springer.com/article/10.1007/s44206-024-00129-8>
Stahl BC and others, ‘A European Agency for Artificial Intelligence: Protecting Fundamental Rights and Ethical Values’ (2022) 45 Computer Law and Security Review
Tovo C, ‘Judicial Review of Harmonized Standards: Changing the Paradigms of Legality and Legitimacy of Private Rulemaking under EU Law’ (2018) 55 Common Market Law Review 1187
Tschider C, ‘Beyond the “Black Box”’ (2021) 98 Denver Law Review <https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3855782>
Tschider C, ‘Legal Opacity: Artificial Intelligence’s Sticky Wicket’ [2021] Iowa Law Review
Tutt A, ‘An FDA for Algorithms’ (2017) 69 Administrative Law Review 83
Veale M and Borgesius F, ‘Demystifying the Draft EU Artificial Intelligence Act — Analysing the Good, the Bad, and the Unclear Elements of the Proposed Approach’ (2021) 22 Computer Law Review International 97
Vosoughi S, Roy D and Aral S, ‘The Spread of True and False News Online’ (2018) 359 Science 1146
Voss WG and Bouthinon-Dumas H, ‘EU General Data Protection Regulation Sanctions in Theory and in Practice’ (2021) 37 Santa Clara High Technology Law Journal
Wachter S and Mittelstadt B, ‘A Right to Reasonable Inferences: Re-Thinking Data Protection Law in the Age of Big Data and AI’ (2019) 2019 Columbia Business Law Review
Wachter S, Mittelstadt B and Floridi L, ‘Why a Right to Explanation of Automated Decision-Making Does Not Exist in the General Data Protection Regulation’ (2017) 7 International Data Privacy Law
Weatherill S, ‘Product Safety Regulation’, EU Consumer Law and Policy (2014)
Zarsky T, ‘Transparent Predictions’ [2013] University of Illinois Law Review <https://papers.ssrn.com/abstract=2324240>
Zenner K, ‘The EU AI Act: Responsibilities of the Commission’ <https://artificialintelligenceact.eu/responsibilities-of-european-commission-ai-office/> accessed 9 August 2024
Zenner K, ‘The EU AI Act: Responsibilities of the Member States’ <https://www.kaizenner.eu/post/ai-act-responsibilities-ms> accessed 9 September 2024
Zenner K, Hacker P and Hallensleben S, ‘A Vision for the AI Office: Rethinking Digital Governance in the EU’ (2024) <https://www.euractiv.com/section/artificial-intelligence/opinion/a-vision-for-the-ai-office-rethinking-digital-governance-in-the-eu/> accessed 24 July 2024
Zuboff S, The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power (Profile Books 2019)
Züger T and Asghari H, ‘Introduction to the Special Issue on AI Systems for the Public Interest’ (2024) 13 Internet Policy Review <https://policyreview.info/articles/analysis/introduction-special-issue-ai-systems-public-interest#editorial>
Downloads
Published
Versions
- 02-06-2025 (2)
- 02-06-2025 (1)
License
Copyright (c) 2025 Katarzyna Söderlund
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
How to Cite
