Opinion

We need more bias in artificial intelligence

What makes one vision more desirable than another is not its neutrality, but whether it can better serve one’s goals in the context of where those goals are being pursued.

By: Date: April 21, 2021 Topic: Digital economy and innovation

This opinion piece was originally published Il Sole 24 Ore.

logo of Il Sole 24 Ore Italian newspaper

The Muller-Lyer optical illusion consists of two lines of equal length that differ only in the direction of arrowheads at either end. Yet, to most observers, the line with arrowheads pointing outwards looks longer than the other. If you grew up in and among buildings with straight walls and 90 degree angles, you have learned to perceive lines according to geometric patterns. Your view of the Muller-Lyer lines is biased.

Artificial intelligence developers sometimes fall into similar traps. They program life-changing applications, into which they project biases. Algorithms have led judges to be harsher on Black offenders when assessing the likelihood that defendants will commit the same crime again. Machine-learning applications favour male over female job applicants (Amazon scrapped its recruiting tool after the system learned to attach a lower score to applications that mentioned the word ‘woman’). Automatic translation programs replicate gender stereotypes. For example translating from a language without gendered pronouns (such as Finnish) into English, the algorithm could suggest using ‘he’ when the action is ‘to work’ and ‘she’ when the action is ‘to wash the laundry’.

We should be very concerned about bias embedded in artificial intelligence. Efforts by public authorities to curb it, such as the regulation being proposed by the European Commission in ‘the Artificial Intelligence Act’, are welcome.

Often, however, biases are not only embedded in the design of the algorithm. They are also external to it, originating in societal biases. Amazon’s recruiting tool inherited the bias from a dataset covering a decade during which most job applications came from men (a symptom of the strong asymmetry in gender power in the technological sector). Similarly, automated translation applications learn gender stereotypes from the thousands of books used to train them. Discrimination against women and minorities is well reflected in literature.

No matter how objective we try to be, the mere decision to adopt artificial intelligence solutions has profound implications. That decision is inherently subjective and thus comes with some political responsibility, which goes beyond simply regulating the use of artificial intelligence. Algorithms learn to be as discriminatory as the society they observe. They then suggest decisions that are inherently discriminatory, and thus contribute to exacerbate discrimination within society. Policy may break this vicious circle.

If public policy aims to improve decision-making and build a more inclusive society, it should deal explicitly with the question of the role of artificial intelligence in achieving the end goal. If artificial intelligence amplifies society’s biases, policy may well need to intervene, either prohibiting its use or embedding counterbalancing biases. For example, algorithms that automatically rank subjective content in online chats could be compelled to attach lower weights to discriminatory comments. This, in effect, would distort the sentiments of a community: perhaps in the collective image of a community populated by men, women are not associated with intellectual work. But the algorithm would then yield a representation of the world closer to what we would like it to be. In medical research, desirable biases could be used to correct gender imbalances. Coronary heart disease is a leading cause of death for women, but men are overrepresented in clinical trials: artificial intelligence could favour women’s enrolment over that of men.

This does not mean that politicians should systematically interfere with technology markets, micromanaging technology development and adoption. But an overall political vision is needed to set the direction of travel, if the aim is to live in a better world.

We often already call for the introduction of desirable biases through affirmative action. Gender quotas address discrimination against women in the selection for positions of power. Quotas do not however simply correct bias. They are also a political statement: gender equality is a tool to change the system structurally. Male-driven decision making in companies or public institutions could indefinitely perpetuate itself, with those in charge continuing to select those who match their male-oriented vision of the world. Imposing quotas is tantamount introducing a bias against that; it means rejecting one way of doing things and instead supporting a different vision that aims to correct historic marginalisation.

Similarly, the discussion on how to improve the use of artificial intelligence in Europe should not be separated from its structural implications.

In the 1960s, anthropologists realised that members of Zulu tribes in South Africa did not fall for the Muller-Lyer illusion. Unlike their peers from Western societies, they saw immediately the lines were of the same length. Their interpretation of the information provided was different. Zulus live in rounded huts in an environment where the sharp angles of European buildings are absent. Their geometric vision is different. Of course, a Zulu might find herself less at ease estimating distances in a European city.

Ultimately, what makes one vision more desirable than another is not its neutrality, but whether it can better serve one’s goals in the context of where those goals are being pursued.

This was produced within the project ‘Future of Work and Inclusive Growth in Europe’, with the financial support of the Mastercard Center for Inclusive Growth.


Republishing and referencing

Bruegel considers itself a public good and takes no institutional standpoint.

Due to copyright agreements we ask that you kindly email request to republish opinions that have appeared in print to [email protected].

Read about event More on this topic
 

Upcoming Event

May
18
09:30

Adapting to European technology regulation: A conversation with Brad Smith, President of Microsoft

Invitation-only event featuring Brad Smith, President and Vice Chair of Microsoft who will discuss regulating big tech in the context of Europe's digital transformation

Speakers: Maria Demertzis and Brad Smith Topic: Digital economy and innovation Location: Bibliothéque Solvay, Rue Belliard 137A, 1000 Bruxelles
Read about event More on this topic
 

Upcoming Event

Jun
7
10:30

Future of Work and Inclusive Growth Annual Conference

Annual Conference of the Future of Work and Inclusive Growth project

Speakers: Erik Brynjolfsson, Francis Green, Ivailo Kalfin, Laura Nurski, J. Scott Marcus, Anoush Margaryan, Julia Nania, Poon King Wang and Fabian Stephany Topic: Digital economy and innovation Location: Bruegel, Rue de la Charité 33, 1210 Brussels
Read article Download PDF
 

Policy Contribution

European governance

Fiscal support and monetary vigilance: economic policy implications of the Russia-Ukraine war for the European Union

Policymakers must think coherently about the joint implications of their actions, from sanctions on Russia to subsidies and transfers to their own citizens, and avoid taking measures that contradict each other. This is what we try to do in this Policy Contribution, focusing on the macroeconomic aspects of relevance for Europe.

By: Olivier Blanchard and Jean Pisani-Ferry Topic: European governance, Macroeconomic policy Date: April 29, 2022
Read about event More on this topic
 

Past Event

Past Event

COVID-19 and the shift to working from home: differences between the US and the EU

What changes has working from home brought on for workers and societies, and how can policy catch up?

Speakers: Jose Maria Barrero, Mamta Kapur, J. Scott Marcus and Laura Nurski Topic: Inclusive growth Location: Bruegel, Rue de la Charité 33, 1210 Brussels Date: April 28, 2022
Read article
 

External Publication

European governance

Green public procurement: A neglected tool in the European Green Deal toolbox?

A new EU regulatory action in public procurement could unlock the potential of green public procurement and add an important element to the European Green Deal toolbox.

By: André Sapir, Tom Schraepen and Simone Tagliapietra Topic: European governance, Green economy Date: April 26, 2022
Read article More on this topic
 

External Publication

What drives implementation of the European Union’s policy recommendations to its member countries?

Article published in the Journal of Economic Policy Reform.

By: Konstantinos Efstathiou and Guntram B. Wolff Topic: Macroeconomic policy Date: April 13, 2022
Read article More by this author
 

Blog Post

European governance

Bold European Union action is needed to support Ukrainian refugees

Hosting Ukrainian refugees could cost European Union countries in excess of €40 billion this year. A dedicated EU fund is needed to manage the fiscal burden.

By: Zsolt Darvas Topic: European governance, Global economy and trade Date: April 6, 2022
Read article More by this author
 

Podcast

Podcast

What to expect from China's innovation drive?

How much has China progressed technologically?

By: The Sound of Economics Topic: Digital economy and innovation, Global economy and trade Date: April 6, 2022
Read article More on this topic
 

Blog Post

Can Europe manage if Russian oil and coal are cut off?

A stop to Russian oil and coal supplies would push Europe into a short and painful adjustment period. But if managed well, disruptions would remain temporary.

By: Ben McWilliams, Giovanni Sgaravatti, Simone Tagliapietra and Georg Zachmann Topic: Green economy Date: March 17, 2022
Read article More on this topic More by this author
 

Blog Post

European governance

A new Thessaloniki offer: the aspirations of Georgia, Moldova, and Ukraine to join the EU

The European Union should grant candidate status to Georgia, Moldova and Ukraine, as part of a long-term stabilisation strategy.

By: Marek Dabrowski Topic: European governance Date: March 15, 2022
Read article More by this author
 

Blog Post

European governance

How should the EU respond to Georgia, Moldova and Ukraine’s membership aspirations?

European Union membership for Georgia, Moldova and Ukraine is at present unrealistic, but they should be offered more than Association Agreements.

By: André Sapir Topic: European governance, Global economy and trade Date: March 14, 2022
Read article More on this topic More by this author
 

Opinion

Global chip shortage may soon turn into an oversupply crisis

Only companies investing in advanced semiconductors will see their margins increase.

By: Alicia García-Herrero Topic: Global economy and trade Date: February 25, 2022
Load more posts