HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

Benchmarking missing-values approaches for predictive models on health databases

Abstract : BACKGROUND: As databases grow larger, it becomes harder to fully control their collection, and they frequently come with missing values: incomplete observations. These large databases are well suited to train machine-learning models, for instance for forecasting or to extract biomarkers in biomedical settings. Such predictive approaches can use discriminative -rather than generative- modeling, and thus open the door to new missing-values strategies. Yet existing empirical evaluations of strategies to handle missing values have focused on inferential statistics. RESULTS: Here we conduct a systematic benchmark of missing-values strategies in predictive models with a focus on large health databases: four electronic health record datasets, a population brain imaging one, a health survey and two intensive care ones. Using gradient-boosted trees, we compare native support for missing values with simple and state-of-the-art imputation prior to learning. We investigate prediction accuracy and computational time. For prediction after imputation, we find that adding an indicator to express which values have been imputed is important, suggesting that the data are missing not at random. Elaborate missing values imputation can improve prediction compared to simple strategies but requires longer computational time on large data. Learning trees that model missing values-with missing incorporated attribute-leads to robust, fast, and well-performing predictive modeling. CONCLUSIONS: Native support for missing values in supervised machine learning predicts better than state-of-the-art imputation with much less computational cost. When using imputation, it is important to add indicator columns expressing which values have been imputed.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03526292
Contributor : Alexandre Perez-Lebel Connect in order to contact the contributor
Submitted on : Friday, January 14, 2022 - 1:44:25 PM
Last modification on : Tuesday, May 17, 2022 - 1:56:02 PM
Long-term archiving on: : Friday, April 15, 2022 - 6:46:27 PM

File

Benchmarking missing-values ap...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03526292, version 1

Citation

Alexandre Perez-Lebel, Gaël Varoquaux, Marine Le Morvan, Julie Josse, Jean-Baptiste Poline. Benchmarking missing-values approaches for predictive models on health databases. GigaScience, Oxford Univ Press, In press. ⟨hal-03526292v1⟩

Share

Metrics

Record views

445

Files downloads

268