Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific Results Summary of a Workshop (2016) / Chapter Skim
Currently Skimming:
1 Introduction
1 Introduction
Pages 1-7
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 1... ...
A lack of reproducibility of scientific results has created some distrust in scientific findings among the general public, scientists, funding agencies, and industries. For example, the pharmaceutical and biotechnology industries depend on the validity of published findings from academic investigators prior to initiating programs to develop new diagnostic and therapeutic agents that benefit cancer patients.
|
From page 2... ...
The views contained in the report are those of individual workshop participants and do not necessarily represent the views of all workshop participants, the planning committee, or the National Academies of Sciences, Engineering, and Medicine. In addition to the summary provided here, materials related to the work shop can be found online at the website of the Board on Mathematical Sciences and Their Applications (http://www.nas.edu/bmsa)
|
From page 3... ...
Workshop Themes Over the course of the workshop, speakers discussed possible reasons as to why studies may lack reproducibility. The following topics were discussed repeatedly throughout the workshop: clarifying definitions of reproducibility and associated terms, improving scientific discovery, increasing the accepted threshold for statistical significance, enhancing and clarifying protocols, uniting the broad scientific community in reproducibility efforts, changing research incentives, increasing
|
From page 4... ...
Clarifying Terminology Throughout the workshop, presenters (Yoav Benjamini, Ronald Boisvert, S teven Goodman, Xiaoming Huo, Randy LeVeque, Giovanni Parmigiani, Victoria Stodden, and Justin Wolfers) and participants referenced the confusion in the terminology associated with reproducibility.
|
From page 5... ...
A central component of this process includes the systematic elimination of alternative explanations for observed associations and the explicit acknowledgement that as new evidence arises, the consensus in the scientific community might change. Presenter Steven Goodman discussed two additional advantages of strengthening replication: (1)
|
From page 6... ...
Increasing Sharing of Research Material The increased availability of supplementary research materials, such as data, code, and software, and expanded research methodology descriptions, was high lighted by several speakers (Micah Altman, Ronald Boisvert, Philip Bourne, Tim Errington, Steven Goodman, Randy LeVeque, John Ioannidis, Mark Liberman, Gianluca Setti, Courtney Soderberg, Victoria Stodden, and Justin Wolfers) and par ticipants as being of significant value to enhancing reproducibility.
|
From page 7... ...
Chapter 4 discusses the way forward by using statistics to achieve reproducibility. Finally, Appendix A lists the registered workshop participants, Appendix B shows the workshop agenda, and Appendix C defines acronyms used throughout this report.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.