We need more bias in artificial intelligence

What makes one vision more desirable than another is not its neutrality, but whether it can better serve one’s goals in the context of where those goals are being pursued.

By: Date: April 21, 2021 Topic: Digital economy and innovation

This opinion piece was originally published Il Sole 24 Ore.

logo of Il Sole 24 Ore Italian newspaper

The Muller-Lyer optical illusion consists of two lines of equal length that differ only in the direction of arrowheads at either end. Yet, to most observers, the line with arrowheads pointing outwards looks longer than the other. If you grew up in and among buildings with straight walls and 90 degree angles, you have learned to perceive lines according to geometric patterns. Your view of the Muller-Lyer lines is biased.

Artificial intelligence developers sometimes fall into similar traps. They program life-changing applications, into which they project biases. Algorithms have led judges to be harsher on Black offenders when assessing the likelihood that defendants will commit the same crime again. Machine-learning applications favour male over female job applicants (Amazon scrapped its recruiting tool after the system learned to attach a lower score to applications that mentioned the word ‘woman’). Automatic translation programs replicate gender stereotypes. For example translating from a language without gendered pronouns (such as Finnish) into English, the algorithm could suggest using ‘he’ when the action is ‘to work’ and ‘she’ when the action is ‘to wash the laundry’.

We should be very concerned about bias embedded in artificial intelligence. Efforts by public authorities to curb it, such as the regulation being proposed by the European Commission in ‘the Artificial Intelligence Act’, are welcome.

Often, however, biases are not only embedded in the design of the algorithm. They are also external to it, originating in societal biases. Amazon’s recruiting tool inherited the bias from a dataset covering a decade during which most job applications came from men (a symptom of the strong asymmetry in gender power in the technological sector). Similarly, automated translation applications learn gender stereotypes from the thousands of books used to train them. Discrimination against women and minorities is well reflected in literature.

No matter how objective we try to be, the mere decision to adopt artificial intelligence solutions has profound implications. That decision is inherently subjective and thus comes with some political responsibility, which goes beyond simply regulating the use of artificial intelligence. Algorithms learn to be as discriminatory as the society they observe. They then suggest decisions that are inherently discriminatory, and thus contribute to exacerbate discrimination within society. Policy may break this vicious circle.

If public policy aims to improve decision-making and build a more inclusive society, it should deal explicitly with the question of the role of artificial intelligence in achieving the end goal. If artificial intelligence amplifies society’s biases, policy may well need to intervene, either prohibiting its use or embedding counterbalancing biases. For example, algorithms that automatically rank subjective content in online chats could be compelled to attach lower weights to discriminatory comments. This, in effect, would distort the sentiments of a community: perhaps in the collective image of a community populated by men, women are not associated with intellectual work. But the algorithm would then yield a representation of the world closer to what we would like it to be. In medical research, desirable biases could be used to correct gender imbalances. Coronary heart disease is a leading cause of death for women, but men are overrepresented in clinical trials: artificial intelligence could favour women’s enrolment over that of men.

This does not mean that politicians should systematically interfere with technology markets, micromanaging technology development and adoption. But an overall political vision is needed to set the direction of travel, if the aim is to live in a better world.

We often already call for the introduction of desirable biases through affirmative action. Gender quotas address discrimination against women in the selection for positions of power. Quotas do not however simply correct bias. They are also a political statement: gender equality is a tool to change the system structurally. Male-driven decision making in companies or public institutions could indefinitely perpetuate itself, with those in charge continuing to select those who match their male-oriented vision of the world. Imposing quotas is tantamount introducing a bias against that; it means rejecting one way of doing things and instead supporting a different vision that aims to correct historic marginalisation.

Similarly, the discussion on how to improve the use of artificial intelligence in Europe should not be separated from its structural implications.

In the 1960s, anthropologists realised that members of Zulu tribes in South Africa did not fall for the Muller-Lyer illusion. Unlike their peers from Western societies, they saw immediately the lines were of the same length. Their interpretation of the information provided was different. Zulus live in rounded huts in an environment where the sharp angles of European buildings are absent. Their geometric vision is different. Of course, a Zulu might find herself less at ease estimating distances in a European city.

Ultimately, what makes one vision more desirable than another is not its neutrality, but whether it can better serve one’s goals in the context of where those goals are being pursued.

This was produced within the project ‘Future of Work and Inclusive Growth in Europe’, with the financial support of the Mastercard Center for Inclusive Growth.

Republishing and referencing

Bruegel considers itself a public good and takes no institutional standpoint.

Due to copyright agreements we ask that you kindly email request to republish opinions that have appeared in print to [email protected].

Read article More on this topic

External Publication

How green are electric vehicles?

A policy paper dissecting existing life cycle assessments of electric vehicles and identifying potential future trends in the different stages of the vehicle life cycle, especially for batteries.

By: Simone Tagliapietra and Victor Vorsatz Topic: Green economy Date: October 26, 2021
Read about event

Upcoming Event


Microchips and Europe's strategic autonomy

Per microchips ad strategic autonomy.

Speakers: Piotr Arak, Alicia García-Herrero, Jay Lewis, Stefan Mengel and Niclas Poitiers Topic: Digital economy and innovation, European governance Location: Bruegel, Rue de la Charité 33, 1210 Brussels
Read about event More on this topic

Upcoming Event


Phasing out COVID-19 emergency support programmes: effects on productivity and financial stability

How can European countries phase out the COVID-19 support measures without having a negative impact on productivity and financial stability?

Speakers: Maria Demertzis and Laurie Mayers Topic: Macroeconomic policy
Read article More by this author


European governance

Can EU fiscal rules jump on the green bandwagon?

By and large, setting a new green golden rule would be a useful addition to the existing EU fiscal framework.

By: Guntram B. Wolff Topic: European governance, Green economy, Macroeconomic policy Date: October 22, 2021
Read article

Blog Post

Inclusive growth

Concentration of artificial intelligence and other frontier IT skills

Online job postings indicate that demand from top tech firms for frontier IT skills is about double their demand for other IT skills. This could indicate increasing concentration of skills in a few firms, with other firms left behind.

By: Wang Jin, Georgios Petropoulos and Sebastian Steffen Topic: Digital economy and innovation, Inclusive growth Date: October 21, 2021
Read about event

Upcoming Event


Future of work and inclusive growth: Annual conference

The inaugural conference of the the project Future of Work and Inclusive Growth in Europe.

Speakers: Janine Berg, Stijn Broecke, Mario Mariniello, Laura Nurski, Sharon Parker, Kim Van Sparrentak and Tilman Tacke Topic: Digital economy and innovation, Inclusive growth Location: Bruegel, Rue de la Charité 33, 1210 Brussels
Read article More by this author


European governance

The inconsistency in global strategic relations

All of this talk on strategic retrenchment and autonomy is the language of escalation, not of appeasement and collaboration.

By: Maria Demertzis Topic: European governance, Global economy and trade Date: October 13, 2021
Read article More by this author

Blog Post

European governance

Pandemic prevention: avoiding another cycle of ‘panic and neglect’

Agreement is needed at international level on mechanisms to ensure better preparedness for the next pandemic.

By: Anne Bucher Topic: European governance, Global economy and trade Date: October 7, 2021
Read article Download PDF More by this author

Policy Contribution

Inclusive growth

Do robots dream of paying taxes?

The digital transition should be managed – and taxed – alongside other societal transitions, but any tax on companies that replace employees with automated systems should be targeted and carefully designed to not stifle innovation.

By: Rebecca Christie Topic: Digital economy and innovation, Inclusive growth Date: October 5, 2021
Read article More by this author



A green fiscal pact

How can the European Union increase green public investment while consolidating budget deficits?

By: The Sound of Economics Topic: European governance, Macroeconomic policy Date: September 29, 2021
Read article More on this topic


Can climate change be tackled without ditching economic growth?

The ultimate answer to the question on whether climate change can be tackled without ditching economic growth depends on our willingness to step up climate action massively.

By: Klaas Lenaerts, Simone Tagliapietra and Guntram B. Wolff Topic: Green economy Date: September 27, 2021
Read article More on this topic More by this author


Inclusive growth

For remote work to work, new ground rules are needed

The pandemic has shown workers and employers that another way to work is possible. The European Union should develop a framework to facilitate hybrid work.

By: Mario Mariniello Topic: Inclusive growth Date: September 23, 2021
Load more posts