Is the EU human rights legal framework able to cope with discriminatory AI?

Main Article Content

Pablo Martínez Ramil

The challenges introduced by AI for the EU anti-discrimination legal framework have been a widely discussed topic among the doctrine. In the light of the 20th anniversary of the EU Charter of Fundamental Rights, the Commission released a regulatory proposal to tackle AI. This paper seeks to determine whether the proposal successfully addresses the existent pitfalls of the EU framework. First, this paper explores the functioning of AI systems that employ machine learning techniques and determines how discrimination takes place. Second, the article examines intellectual property rights as one of the main barriers for accountability and redressal of violations committed by an AI system. Third, the state of the discussion concerning the pitfalls of the existent EU approach towards non-discrimination is addressed. The available academic literature suggests that discriminatory outputs produced by an AI will amount to indirect discrimination in most scenarios. In this sense, cases of indirect proxy discrimination will likely pass the proportionality test, therefore justifying the discriminatory output. The last section of this article studies the Commission’s regulatory proposal. Although the document seems to effectively tackle discrimination caused by biased training data sets, this paper concludes that intellectual property rights and proxy discrimination still constitute significant barriers for the enforcement of anti-discrimination law.

Keywords
human rights, Charter of Fundamental Rights of the European Union, artificial antelligence, AI, algorithms, trade secrecy law, non-discrimination

Article Details

How to Cite
Martínez Ramil, Pablo. “Is the EU human rights legal framework able to cope with discriminatory AI?”. IDP. Internet, Law and Politics E-Journal, no. 34, pp. 1-14, doi:10.7238/idp.v0i34.387481.
Author Biography

Pablo Martínez Ramil, Department of International and European Law. Faculty of Law, Palacký University Olomouc

Ph.D. Researcher at the Department of International and European Law. Faculty of Law, Palacký University Olomouc. He holds a Bachelor's Degree in Political Science and Public Administration from the University of Salamanca (2012-2017), a Bachelor's Degree in Law from the University of Salamanca (2012-2017). He also holds a Master’s Degree in Political and Social Leadership from the University Carlos III of Madrid. (2017-2018) a Master’s Degree on International and European Law by the Palacky University of Olomouc (2018-2020) and finally a Ph.D. on International and European Law by the Palacky University of Olomouc (2020-2021). Pablo has previous experience as a Public Affairs Consultant in Lasker Integrated services. Lobbying and Institutional Relations (2018). He is also a social activist and a volunteer: International Amnesty in the regional structure of Castilla y León (2018), Legal Clinic of Social Action. University of Salamanca (2017), Curricular practices in the local group of International Amnesty in Salamanca (2016) and Voluntary Service in the Red Cross (2015). Over the years he has won the following awards: Master on Political and Social Leadership’ Extraordinary Prize granted by the University Carlos III of Madrid. 2018 and Member of the Czech team in the 2020 Telders International Law Moot Court Competition.

References

Scientific literature

ANDERSEN, L. (2018). “Human Rights in the age of Artificial Intelligence”. In: Access Now, pp. 1-40 [online]. DOI: https://doi.org/10.1007/978-1-4842-3808-0_1

AIZENBERG, E.; VAN DEN HOVEN, J. (2020). “Designing for human rights in AI”. In: Big Data & Society, pp. 1-14 [online]. DOI: https://doi.org/10.1177/2053951720949566

GRUODYTĖ, E.; MILČIUVIENĖ, S.; PALIONIENĖ, N. (2020). “The Principle of Direct Effect in Criminal Law: Theory and Practice”. In: European Studies, vol. 7, pp. 66-87.

HACKER, P. (2018). “Teaching fairness to artificial intelligence: Existing and novel strategies against algorithmic discrimination under EU Law”. In: Common Market Law Review, vol. 55, no. 4, pp. 1143-1183.

HUSEINZADE, N. (2021). “Algorithm Transparency: How to eat the cake and have it too”. In: European Law Blog [online]. Available at: https://europeanlawblog.eu/2021/01/27/algorithm-transparency-how-to-eat-the-cake-and-have-it-too/ [Accessed: 15 April 2021].

IOANNIDIS, N.; GKOTSOPOULOU, O. (2021). “The Palimpsest of Conformity Assessment in the Proposed Artificial Intelligence Act: A Critical Exploration of Related Terminology”. In: European Law Blog [online]. Available at: https://europeanlawblog.eu/2021/07/02/the-palimpsest-of-conformity-assessment-in-the-proposed-artificial-intelligence-act-a-critical-exploration-of-related-terminology/ [Accessed: 13 August 2021].

KOCHLING, A.; WEHNER, M. C. (2020). “Discriminated by an algorithm: a systemic review of discrimination and fairness by algorithmic decision-making in the context of HR recruitment and HR development”. In: Business Research, vol. 13, pp. 795-848 [online]. DOI: https://doi.org/10.1007/s40685-020-00134-w

LIU, H.; DANAHER, J. et. al. (2020). “Artificial Intelligence and Legal Disruption: A New Model for Analysis”. In: Law Innovation and Technology, vol. 12, no. 2, pp. 1-46.

RASO, F. et al. (2018). “Artificial Intelligence & Human Rights: Opportunities & Risks”. In: Berkman Klein Center for Internet & Society at Harvard University, pp. 1-63 [online]. DOI: https://doi.org/10.2139/ssrn.3259344

SUPPA, A.; BUREŠ, P. (2020). “Can Multinational Corporations be responsible for human rights violation of its outsource company? Response of national or international law?”. In: International and Comparative Law Review, vol. 20, no. 1, pp. 153-179 [online]. DOI: https://doi.org/10.2478/iclr-2020-0007

WACHTER, S.; MITTELSTADT, B.; FLORIDI, L. (2017). “Why a Right to Explanation of Automated Decision-Making Does Not Exist in the General Data Protection Regulation”. In: International Data Privacy Law, vol. 7, no. 2, pp. 76-99 [online]. DOI: https://doi.org/10.1093/idpl/ipx005

WACHTER, S. (2020). “Affinity Profiling and Discrimination by Association in Online Behavioural Advertising”. In: Berkeley Technology Law Journal, vol. 35, no. 2, pp. 1-73.

Books

HAMULAK, O.; STEHLÍK, V. (2013). European Union Constitutional Law: Revealing the Complex Constitutional System of the European Union. Olomouc: Palacký University Olomouc.

RAMIRO TROITIÑO, D.; KERIKMÄE, T.; CHOCHIA, A. (2020). “Foreign Affairs of the European Union: How to Become an Independent and Dominant Power in the International Arena”. In: The EU in the 21st Century, pp. 209-230 [online]. DOI: https://doi.org/10.1007/978-3-030-38399-2_12

RAMIRO TROITIÑO, D.; KERIKMÄE, T.; DE LA GUARDIA, R.; PÉREZ SÁNCHEZ, G. (eds). The EU in the 21st Century [online]. Cham: Springer. DOI: https://doi.org/10.1007/978-3-030-38399-2_12

Legal sources

Legal norms

C:2008:115:TOC. Consolidated Version of the Treaty on European Union.

EUR-Lex-52021PC0206. Proposal for a Regulation of the European Parliament and of the Council. Laying down harmonized rules on Artificial Intelligence (Artificial Intelligence Act) and amending certain Union legislative acts.

EUR-Lex-52021PC0206. Annexes to the Proposal for a Regulation of the European Parliament and of the Council. Laying down harmonized rules on Artificial Intelligence (Artificial Intelligence Act) and amending certain Union legislative acts.

EUR-Lex-32000L0078. Council Directive 2000/78/EC of 27 November 2000 establishing a general framework for equal treatment in employment and occupation.

EUR-Lex-32016L0943. Directive (EU) 2016/943 of the European Parliament and of the Council of 8 June 2016 on the protection of undisclosed know-how and business information (trade secrets) against their unlawful acquisition, use and disclosure.

/C 364/01. Charter of fundamental rights of the European Union. Luxembourg, Office for Official Publications of the European Communities.

EUR-Lex-52008PC0426. Proposal for a Council Directive on implementing the principle of equal treatment between persons irrespective of religion or belief, disability, age or sexual orientation COM/2008/0426 final.

EPC1973. Convention on the Grant of European Patents of 5 October 1973.

EUR-Lex-32016R0679. Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation).

Case-law

Case 43/75 of 8 April 1976. Defrenne v. Sabena (no. 2).

Case 170/84 of 13 May 1986. Bilka-Kaufhaus GmbH v Karin Weber von Hartz.

Case C-167/97 of 9 February 1999. Regina v Secretary of State for Employment, ex parte Nicole Seymour-Smith and Laura Perez.

Case C-13/05 of 11 July 2006. Sonia Chacón Navas v Eurest Colectividades SA.

Case T-201/04 of 17 September 2007. Microsoft Corp. v Commission of the European Communities.

Case C-303/06 of 17 July 2008. S. Coleman v Attridge Law and Steve Law.

Other sources

Unesco. Artificial Intelligence [online]. Ad Hoc Expert Group for the preparation of a draft text of a recommendation on the ethics of artificial intelligence. First Draft of the Recommendation on the Ethics of Artificial Intelligence in UNESCO, Paris, 7 September 2020. Available at: https://en.unesco.org/artificial-intelligence/ethics#aheg

AMAZON. What is data labeling for machine learning? [online] . Available at: https://aws.amazon.com/es/sagemaker/groundtruth/what-is-data-labeling/ [Accessed: 13 August 2021].

European Commission White Paper on Artificial Intelligence: a European approach to excellence and trust [online] [2020]. Available at: https://ec.europa.eu/info/publications/white-paper-artificial-intelligence-european-approach-excellence-and-trust_en

European Patent Office, Guidelines for Examination, 3.3.1 Artificial Intelligence and Machine Learning [online] [Accessed: 15 April 2021]. Available at: https://www.epo.org/law-practice/legal-texts/html/guidelines/e/g_ii_3_3_1.htm

DASTIN, J. (2018). “Amazon scraps secret AI recruiting tool that showed bias against women”. In: Reuters [online]. Available at: https://www.reuters.com/article/us-amazon-com-jobs-automation-insight/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G [Accessed: 20 April 2021].

DILMEGANI, C. (2021). “Data Labeling in 2021: How to Choose a Data Labeling Partner”. In: AI Multiple [online]. Available at: https://research.aimultiple.com/data-labeling/ [Accessed:13 August 2021].

Furtwangen University. Machine Learning Work Group [online]. Available at: https://www.hs-furtwangen.de/en/faculties/computer-science/research/translate-to-english-machine-learning/ [Accessed: 11 September 2021].

HENLEY, J.; BOOTH, R. (2020). “Welfare surveillance system violates human rights, Dutch court rules”. In: The Guardian [online]. Available at: https://www.theguardian.com/technology/2020/feb/05/welfare-surveillance-system-violates-human-rights-dutch-court-rules [Accessed: 20 April 2021].

LISA COLE, N. (2019). “Understanding segregation today”. In: ThoughtCo [online]. Available at: https://www.thoughtco.com/understanding-segregation-3026080 [Accessed: 14 August 2021].

REINHOLD, F. (2021). “Algorithm Watch’s response to the European Commission’s proposed regulation on Artificial Intelligence – A major step with major gaps”. In: Algorithm Watch [online]. Available at: https://algorithmwatch.org/en/response-to-eu-ai-regulation-proposal-2021/ [Accessed: 1 May 2021].

XORIANT. Decision Trees for Classification: A Machine Learning Algorithm [blog]. Available at: https://www.xoriant.com/blog/product-engineering/decision-trees-machine-learning-algorithm.html [Accessed: 13 August 2021].

ZHANG, M. (2015). “Google Photos Tags Two African-Americans As Gorillas Through Facial Recognition Software”. In: Forbes [online]. Available at: https://www.forbes.com/sites/mzhang/2015/07/01/google-photos-tags-two-african-americans-as-gorillas-through-facial-recognition-software/?sh=26a7b5f4713d [Accessed: 10 April 2021].