Enhancing Scientific Reproducibility in Biomedical Research Through Transparent Reporting: Proceedings of a Workshop

National Academies Press, Washington DC; 2021
Authored By:
Theresa Wizemann, Sylvia Ncha, Amanda Wagner Gee, and Carolyn Shore, Rapporteurs
Consumer wearables and sensors are a rich source of data about patients’ daily disease and symptom burden, particularly in the case of movement disorders like Parkinson’s disease (PD). However, interpreting these complex data into so-called digital biomarkers requires complicated analytical approaches, and validating these biomarkers requires sufficient data and unbiased evaluation methods. Here we describe the use of crowdsourcing to specifically evaluate and benchmark features derived from accelerometer and gyroscope data in two different datasets to predict the presence of PD and severity of three PD symptoms: tremor, dyskinesia, and bradykinesia. Forty teams from around the world submitted features, and achieved drastically improved predictive performance for PD status (best AUROC = 0.87), as well as tremor- (best AUPR = 0.75), dyskinesia- (best AUPR = 0.48) and bradykinesia-severity (best AUPR = 0.95). Sharing knowledge is what drives scientific progress – each new advance or innovation in biomedical research builds on previous observations. However, for experimental findings to be broadly accepted as credible by the scientific community, they must be verified by other researchers. An essential step is for researchers to report their findings in a manner that is understandable to others in the scientific community and provide sufficient information for others to validate the original results and build on them. In recent years, concern has been growing over a number of studies that have failed to replicate previous results and evidence from larger meta-analyses, which have pointed to the lack of reproducibility in biomedical research.
Published in:
National Academies Press

More Publications

May 19, 2023

Nature Reviews Neurology

Global synergistic actions to improve brain health for human development

April 20, 2023

Nature Mental Health

Machine learning-based identification of a psychotherapy-predictive electroencephalographic signature in PTSD

February 13, 2023

Frontiers in Aging Neuroscience

Machine learning within the Parkinson’s progression markers initiative: Review of the current state of affairs

September 9, 2022


Deep Learning for Daily Monitoring of Parkinson’s Disease Outside the Clinic Using Wearable Sensors

June 1, 2022

JAMA Network Open

Association of Posttraumatic Stress Disorder With Accelerated Cognitive Decline in Middle-aged Women

March 23, 2022

Journal of Neurotrauma

A Framework to Advance Biomarker Development in the Diagnosis, Outcome Prediction, and Treatment of Traumatic Brain Injury