Volume 54 | Number 6 | December 2019

Abstract List

K. John McConnell Ph.D., Stephan Lindner PhD


Objective

To demonstrate the performance of methodologies that include machine learning (ML) algorithms to estimate average treatment effects under the assumption of exogeneity (selection on observables).


Data Sources

Simulated data and observational data on hospitalized adults.


Study Design

We assessed the performance of several ML‐based estimators, including Targeted Maximum Likelihood Estimation, Bayesian Additive Regression Trees, Causal Random Forests, Double Machine Learning, and Bayesian Causal Forests, applying these methods to simulated data as well as data on the effects of right heart catheterization.


Principal Findings

In Monte Carlo studies, ML‐based estimators generated estimates with smaller bias than traditional regression approaches, demonstrating substantial (69 percent‐98 percent) bias reduction in some scenarios. Bayesian Causal Forests and Double Machine Learning were top performers, although all were sensitive to high dimensional (>150) sets of covariates.


Conclusions

ML‐based methods are promising methods for estimating treatment effects, allowing for the inclusion of many covariates and automating the search for nonlinearities and interactions among variables. We provide guidance and sample code for researchers interested in implementing these tools in their own empirical work.