Blog Post

Machine learning and economics

Machine learning (ML), together with artificial intelligence (AI), is a hot topic. Economists have been looking into machine learning applications not only to obtain better prediction, but also for policy targeting. We review some of the contributions.

By: Date: November 29, 2018 Topic: Innovation & Competition Policy

Writing on PWC blog last year, Hugh Dance and John Hawksworth discussed what machine learning (ML) could do for economics in the future. One aspect is that of prediction vs causal inference. Standard econometric models are well suited to understanding causal relationships between different aspects of the economy, but when it comes to prediction they tend to “over-fit” samples and sometimes generalise poorly to new, unseen data.

By focusing on prediction problems, machine learning models can instead minimise forecasting error by trading off bias and variance. Moreover, while econometric models are best kept relatively simple and easy to interpret, ML methods are capable of handling huge amounts of data, often without sacrificing interpretation.

Susan Athey provides an assessment of the early contributions of ML to economics, as well as predictions about its future contributions. At the outset, the paper highlights that ML does not add much to questions about identification, which are of concern when the object of interest, e.g. a causal effect, can be estimated with infinite data. Rather, ML yields great improvements when the goal is semi-parametric estimation or when there are a large number of covariates relative to the number of observations.

The second theme is that a key advantage of ML is that it views empirical analysis as “algorithms” that estimate and compare many alternative models. This approach contrasts with economics, where in principle the researcher picks a model based on principles and estimates it once. The third theme deals with the  “outsourcing” of model selection to algorithm. While it manages the “simple” problems fairly well, it is not well suited for the problems of greatest interest for empirical researchers in economics, such as causal inference, where there is typically no unbiased estimate of the ground truth available for comparison. Finally, the paper notes that the algorithms also have to be modified to provide valid confidence intervals for estimated effects when the data is used to select the model.

Athey thus thinks that using ML can provide the best of both worlds: the model selection is data-driven, systematic, and considers a wide range of models; all the while, the model selection process is fully documented and confidence intervals take the entire algorithm into account. She also expects the combination of ML and newly available datasets to change economics in fundamental ways, ranging from new questions and new approaches to collaboration (larger teams and interdisciplinary interaction), to a change in how involved economists are in the engineering and implementation of policies.

David McKenzie writes on the World Bank blog that ML can be used for development interventions and impact evaluations, in measuring outcomes and targeting treatments, measuring heterogeneity, and taking care of confounders.

One of the biggest use cases currently seems to be in getting basic measurements in countries with numerous gaps in the basic statistics – and machine learning has been applied to this at both the macro- and micro-level. But scholars are increasingly looking into whether ML could be useful also in targeting interventions, i.e. in deciding when and where/for whom to intervene.

McKenzie, however, points to several unanswered challenges, such as the question of the gold standard for evaluating these methods. Supervised ML requires a labelled training dataset and a metric for evaluating performance, but the very lack of data that these approaches are trying to solve also makes it hard to evaluate. Second, there are concerns about how stable many of the predicted relationships are, and about the behavioural responses that could affect the reliability of ML for treatment selection. Lastly, McKenzie also points to several ethics, privacy and fairness issues that could come into play.

Monica Andini, Emanuele Ciani, Guido de Blasio, Alessio D’Ignazio take up the question of policy targeting with ML in a recent VoxEU article and two papers. They present two examples of how to employ ML to target those groups that could plausibly gain more from the policy.

One example considers a tax rebate scheme introduced in Italy in 2014 with the purpose of boosting household consumption. The Italian government opted for a coarse targeting rule and provided the rebate only to employees with annual income between €8,145 and €26,000. Given the policy objective, an alternative could have been to target consumption-constrained households who are supposed to consume more out of the bonus. Applying ML to two household survey waves, the authors implement the second strategy. An additional econometric analysis suggests that this version of targeting would have been better, because the effect of the rebate is estimated to be positive only for the consumption-constrained households.

In the second application, Andini et al. focus on the “prediction policy problem” of assigning public credit guarantees to firms. In principle, guarantee schemes should target firms that are both creditworthy and rationed in their access to credit. In practice, existing guarantee schemes are usually based on naïve rules that exclude borrowers with low creditworthiness.

Aldini et al. propose an alternative assignment mechanism based on ML predictions, in which both creditworthiness and credit rationing are explicitly addressed. A simple comparison of the growth rate of disbursed bank loans in the years following the provision of the guarantee shows – confirmed by a regression discontinuity design – that the ML-targeted group performed better.


Republishing and referencing

Bruegel considers itself a public good and takes no institutional standpoint. Anyone is free to republish and/or quote this post without prior consent. Please provide a full reference, clearly stating Bruegel and the relevant author as the source, and include a prominent hyperlink to the original post.

Read article
 

Blog Post

L'IA a besoin d'humains qualifiés

L'adoption des technologies IA repose moins sur des scientifiques de haut niveau que sur des spécialistes des données et des programmeurs compétents qui peuvent mettre en pratique les algorithmes d'apprentissage profond existants à des fins commerciales.

By: Julia Anderson and Guntram B. Wolff Topic: European Macroeconomics & Governance, Innovation & Competition Policy Date: October 5, 2020
Read article
 

Blog Post

Europe has an artificial-intelligence skills shortage

How severe is Europe’s dearth of AI talent and how does it compare to the United States, China and the United Kingdom – the world’s AI champions?

By: Julia Anderson, Paco Viry and Guntram B. Wolff Topic: European Macroeconomics & Governance, Innovation & Competition Policy Date: August 27, 2020
Read article More on this topic
 

Blog Post

Artificial intelligence’s great impact on low and middle-skilled jobs

Artificial intelligence and machine learning will significantly transform low-skilled jobs that have not yet been negatively affected by past technological change.

By: Sybrand Brekelmans and Georgios Petropoulos Topic: Innovation & Competition Policy Date: June 29, 2020
Read about event More on this topic
 

Past Event

Past Event

The role of AI in healthcare

How can AI help us fight through a pandemic crisis?

Speakers: Dimitris Bertsimas, Georgios Petropoulos, Effy Vayena and Reinhilde Veugelers Topic: Innovation & Competition Policy Location: Bruegel, Rue de la Charité 33, 1210 Brussels Date: June 23, 2020
Read article Download PDF More on this topic
 

Working Paper

Occupational change, artificial intelligence and the geography of EU labour markets

From 2002 up to 2009, the economies of European Union countries went through a skill upgrading, rather than a polarisation between low-skill and high-skill jobs. After 2009, this changed, with declining real wages and a significant increase in the share of workers in low-skill jobs. This assessment evaluates these changes in connection with labour market variables, population densities and the emergence of machine learning and artificial intelligence.

By: Sybrand Brekelmans and Georgios Petropoulos Topic: Innovation & Competition Policy Date: June 15, 2020
Read about event More on this topic
 

Past Event

Past Event

Find my virus: Mobilising AI and big data to fight COVID-19

At this event, the panellists will discuss the role of AI and big data in the fight against the coronavirus crisis.

Speakers: J. Scott Marcus, Alex Sandy Pentland, Georgios Petropoulos and Marietje Schaake Topic: Innovation & Competition Policy Location: Bruegel, Rue de la Charité 33, 1210 Brussels Date: April 2, 2020
Read article More on this topic More by this author
 

Blog Post

Artificial intelligence in the fight against COVID-19

Artificial intelligence can help fight the coronavirus through applications including population screening, notifications of when to seek medical help and tracking how infection spreads. The COVID-19 outbreak has triggered intense work on such applications, but it will take time before results become visible.

By: Georgios Petropoulos Topic: Innovation & Competition Policy Date: March 23, 2020
Read article More on this topic More by this author
 

Blog Post

Big data versus COVID-19: opportunities and privacy challenges

All available resources need to be brought to bear on the novel coronavirus COVID-19. To what extent can digital technology help? What risks are there in using big data to combat COVID-19, and what policies can mitigate any limitations that these risks impose?

By: J. Scott Marcus Topic: Innovation & Competition Policy Date: March 23, 2020
Read article More by this author
 

Opinion

Europe may be the world’s AI referee, but referees don’t win

The EU needs to invest in homegrown technology.

By: Guntram B. Wolff Topic: European Macroeconomics & Governance, Innovation & Competition Policy Date: February 19, 2020
Read article More on this topic More by this author
 

Podcast

Podcast

The EU's plan to catch up on artificial intelligence

While the US and China have been setting the pace when it comes to Artificial Intelligence, the European Union seems to be lagging behind. What are the Commission's plans to finally catch up? Will AI increase the gap between big and small companies? This week, Nicholas Barrett is joined by Julia Anderson and Guntram Wolff to discuss the EU's plan for AI.

By: The Sound of Economics Topic: Innovation & Competition Policy Date: February 14, 2020
Read article More on this topic More by this author
 

Blog Post

The dynamics of data accumulation

The bigger you are, the more data you can harvest. But does data accumulation necessarily breed monopolies in AI and related machine learning markets?

By: Julia Anderson Topic: Innovation & Competition Policy Date: February 11, 2020
Read article More on this topic More by this author
 

Podcast

Podcast

Industrial revolutions might not be as fun as they look

AI promises a new industrial revolution but history warns us that industrial revolutions aren't always that fun for people in the eye of the storm. This week, Nicholas Barrett and Maria Demertzis spoke with Dr. Carl Frey, author of the book "The technology trap: capital, labor, and power in the age of automation", and Robert D. Atkinson, President of Information Technology and Innovation Foundation (ITIF), about how artificial intelligence will affect the job market.

By: The Sound of Economics Topic: Innovation & Competition Policy Date: February 5, 2020
Load more posts