Enhancing Scientific Reproducibility in Biomedical Research Through Transparent Reporting: Proceedings of a Workshop

National Academies Press, Washington DC; 2021
Authored By:
Theresa Wizemann, Sylvia Ncha, Amanda Wagner Gee, and Carolyn Shore, Rapporteurs
Consumer wearables and sensors are a rich source of data about patients’ daily disease and symptom burden, particularly in the case of movement disorders like Parkinson’s disease (PD). However, interpreting these complex data into so-called digital biomarkers requires complicated analytical approaches, and validating these biomarkers requires sufficient data and unbiased evaluation methods. Here we describe the use of crowdsourcing to specifically evaluate and benchmark features derived from accelerometer and gyroscope data in two different datasets to predict the presence of PD and severity of three PD symptoms: tremor, dyskinesia, and bradykinesia. Forty teams from around the world submitted features, and achieved drastically improved predictive performance for PD status (best AUROC = 0.87), as well as tremor- (best AUPR = 0.75), dyskinesia- (best AUPR = 0.48) and bradykinesia-severity (best AUPR = 0.95). Sharing knowledge is what drives scientific progress – each new advance or innovation in biomedical research builds on previous observations. However, for experimental findings to be broadly accepted as credible by the scientific community, they must be verified by other researchers. An essential step is for researchers to report their findings in a manner that is understandable to others in the scientific community and provide sufficient information for others to validate the original results and build on them. In recent years, concern has been growing over a number of studies that have failed to replicate previous results and evidence from larger meta-analyses, which have pointed to the lack of reproducibility in biomedical research.
Published in:
National Academies Press

More Publications

April 18, 2024

Nature Genetics

Genome-wide association analyses identify 95 risk loci and provide insights into the neurobiology of post-traumatic stress disorder

March 5, 2024

Translational Psychiatry

Potential causal association between gut microbiome and posttraumatic stress disorder

January 29, 2024

Scientific Reports

Differential recruitment of brain circuits during fear extinction in non-stressed compared to stress resilient animals

December 29, 2023

Journal of Law and the Biosciences

Defusing the legal and ethical minefield of epigenetic applications in the military, defense, and security context

August 1, 2023

Journal of Psychopharmacology

Improving Translational Relevance in Preclinical Psychopharmacology (iTRIPP)

July 29, 2023

Frontiers in Neurology

Models and methods: a perspective of the impact of six IMI translational data-centric initiatives for Alzheimer’s disease and other neuropsychiatric disorders