This article was accepted into the corpus but its outbound wikilinks were never NER-processed — typical at the deepest BFS hop or when the run's entity cap was reached. No expansion funnel to show.
| Reproducibility Challenge | |
|---|---|
| Name | Reproducibility Challenge |
| Type | Scientific reliability initiative |
| Focus | Replication, validation, methodological transparency |
Reproducibility Challenge
The Reproducibility Challenge is a coordinated effort addressing the replication and validation of empirical findings in science, medicine, and social inquiry, tracing roots through crises and reforms involving institutions and scholars. Major actors and events from John Ioannidis to Amgen and from Open Science Framework to National Academies of Sciences, Engineering, and Medicine have shaped practices, debates, and policy responses. The movement intersects with initiatives led by Francis Collins, Brian Nosek, Daniel Kahneman, Ioannidis, John and organizations such as Wellcome Trust, European Research Council, National Institutes of Health, and Bill & Melinda Gates Foundation.
The Reproducibility Challenge denotes systematic attempts to reproduce experimental, statistical, and computational results originating in studies associated with figures, tables, and datasets from laboratories and research groups such as Harvard University, Stanford University, University of Cambridge, MIT, and University of Oxford while implicating journals like Nature (journal), Science (journal), The Lancet, Proceedings of the National Academy of Sciences, and PLoS ONE. It encompasses replication types discussed by scholars including Andrew Gelman, Sander Greenland, Paul Meehl, Nancy Cartwright and organizations such as Center for Open Science, Open Science Framework, Reproducibility Project: Psychology, and Meta-Research Innovation Center at Stanford. The scope spans fields represented by Psychological Science, Nature Neuroscience, JAMA, Lancet Psychiatry, Science Translational Medicine, and Cell (journal).
Early critiques by Karl Popper and later methodological scandals involving groups tied to Benedict Carey, Diederik Stapel, Hwang Woo-suk, Andrew Wakefield, and controversies at Potti, Anil-associated institutions catalyzed scrutiny. Landmark events include replication projects led by Open Science Collaboration, institutional responses from Royal Society, policy statements by National Institutes of Health, high-profile failures reported by Amgen and Bayer, and influential papers by John Ioannidis and Ioannidis, John that stimulated meta-research at places like Meta-Research Innovation Center at Stanford and Center for Open Science. Investigations by journals such as Retraction Watch and actions by funders including Wellcome Trust and European Research Council marked turning points.
Attributions cite incentives at institutions such as Harvard University, Johns Hopkins University, University College London, and Imperial College London; publication pressures tied to Nature (journal), Science (journal), and Cell (journal); design shortcomings highlighted by Douglas Altman, Paul Glasziou, and Iain Chalmers; statistical misuse discussed by Ronald Fisher, Jerzy Neyman, Egon Pearson, Bradley Efron, and Andrew Gelman; and incentive reforms promoted by Wellcome Trust, National Institutes of Health, European Research Council, and Bill & Melinda Gates Foundation. Other drivers include data access policies advocated by Committee on Publication Ethics, transparency efforts from Center for Open Science, and training programs at Wellcome Trust and National Academy of Medicine.
Assessment methods derive from protocols used by Open Science Collaboration, replication frameworks by Brian Nosek, registered reports pioneered by Royal Society-endorsed journals, pre-registration systems like ClinicalTrials.gov, and meta-analytic techniques refined by John Tukey, Jacob Cohen, and Herman Wold. Tools include version control systems developed in labs at Massachusetts Institute of Technology, computational workflows popularized by Fernando Pérez and Guido van Rossum, containerization platforms from Docker, Inc., and data repositories such as Dryad (repository), Figshare, and Zenodo (service). Evaluation metrics are debated among scholars including Ioannidis, John, Andrew Gelman, Sander Greenland, and organizations like National Academies of Sciences, Engineering, and Medicine.
Reform efforts feature policy shifts by National Institutes of Health, data-sharing mandates from Wellcome Trust and European Research Council, reproducibility pledges by Center for Open Science, registered report adoption by journals such as Royal Society Open Science and Nature (journal), reproducibility centers at Stanford University and University of Bristol, and training programs backed by Gordon and Betty Moore Foundation and Bill & Melinda Gates Foundation. Technological initiatives include platforms built by Open Science Framework, workflow standards advanced by Software Carpentry and Data Carpentry, and reproducible computing advocated by RStudio (company) and Jupyter Project.
Consequences have included editorial policy changes at Nature (journal), funding conditions from National Institutes of Health and Wellcome Trust, curricular updates at University of Oxford and Harvard University, and legislative attention from bodies like European Commission and national science ministries in United Kingdom, United States, and Germany. High-profile replication failures influenced clinical guideline revisions referenced by World Health Organization and reimbursement decisions involving regulatory agencies such as U.S. Food and Drug Administration and European Medicines Agency. The movement reshaped assessment cultures in institutions including Max Planck Society, CNRS, National Science Foundation, and Japan Society for the Promotion of Science.
Psychology case studies include the Reproducibility Project: Psychology and critiques by Daniel Kahneman, Amos Tversky, Elizabeth Loftus, and Diederik Stapel; biomedical examples involve replication efforts by Amgen and Bayer, controversies tied to Hwang Woo-suk and Andrew Wakefield, and clinical trial transparency via ClinicalTrials.gov and AllTrials; economics discussions reference work from Angus Deaton, Esther Duflo, Abhijit Banerjee, and replication databases maintained at Harvard Dataverse; neuroscience issues relate to studies from Allen Institute for Brain Science, Karl Deisseroth, Ed Boyden, and reproducibility projects in neuroimaging. Discipline-specific repositories and standards include practices promoted by Dryad (repository), Figshare, Zenodo (service), and consortia such as FAIR Data Principles proponents and initiatives by International Committee of Medical Journal Editors.
Category:Scientific methodology