ULibraries Research Guides: Resources for Researchers: Reproducibility of Research

What is reproducible research?

"The term reproducible research refers to the idea that the ultimate product of academic research is the paper along with the full computational environment used to produce the results in the paper such as the code, data, etc. that can be used to reproduce the results and create new work based on the research."

Citation: Reproducibility. (2016, April 24). In Wikipedia, The Free Encyclopedia. Retrieved April 28, 2016, from https://en.wikipedia.org/w/index.php?title=Reproducibility&oldid=716934190

Getting Started

Initial steps toward reproducible research
Karl Broman (UW-Madison) outlines 8 steps towards making research reproducible.
Getting Started with Reproducible Research
A workflow and 5 practical tips for reproducible research, excerpted from "Reproducible Research with R and RStudio."
Reproducibility Resources and Guidelines by Topic
Help with meeting NIH Rigor for Reproducibility Requirements.

Equator Network
The EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network is an international initiative that seeks to improve the reliability and value of published health research literature by promoting transparent and accurate reporting and wider use of robust reporting guidelines.
Enhancing Research Reproducibility
Recommendations from the Federation of American Societies for Experimental Biology. January 2016.
NIH Rigor and Reproducibility in Grant Applications
The information provided on this website is designed to assist the extramural community in addressing rigor and transparency in NIH grant applications and progress reports.
Principles and Guidelines for Reporting Preclinical Research
NIH held a joint workshop in June 2014 with the Nature Publishing Group and Science on the issue of reproducibility and rigor of research findings, with journal editors representing over 30 basic/preclinical science journals in which NIH-funded investigators have most often published. The workshop focused on identifying the common opportunities in the scientific publishing arena to enhance rigor and further support research that is reproducible, robust, and transparent.
Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science
Report of the Subcommittee on Replicability in Science. May 2015.
Data Access & Research Transparency (DA-RT)
Efforts to increase transparency in social science led by the American Political Science Association.
Data best practices
This guide gives great tips on file names and formats, versions, metadata, and more.

Retraction Watch
A blog that reports on retractions in scientific literature.
Center for Open Science
COS is a non-profit technology company providing free and open services to increase inclusivity and transparency of research. COS supports shifting incentives and practices to align more closely with scientific values.
Reproducibility Project: Cancer Biology
Independently replicating a subset of experimental results from a number of high-profile papers in the field of cancer biology studies published between 2010-2012 using the Science Exchange network of expert scientific labs.
Curate Science
Curate Science summarizes independent direct replication results meta-analytically so researchers can calibrate their beliefs in empirical findings according to independent replication evidence.
The NIH Commons
The Commons is a shared virtual space where scientists can work with the digital objects of biomedical research, i.e. it is a system that will allow investigators to find, manage, share, use and reuse data, software, metadata and workflows.
Researchobjects.org
Aims to map the landscape of initiatives and activity in the development of Research Objects, an emerging approach to the publication, and exchange of scholarly information on the Web. Research objects are not just data, not just collections, but any digital resource that aims to go beyond the PDF for scholarly publishing!
ReproZip
Pack your research along with all necessary data files, libraries, environment variables and options. Then anybody can reproduce the research on a different machine, without tracking down and installing the dependencies, or even having to run the same operating system!

Related Classes & Tutorials

University of Utah
Online Resources

PHIL 7570/MBIOL 7570: Case Studies and Research Ethics (1 credit hour)
An examination of research integrity and other ethical issues involved in scientific research. Topics may include scientific fraud, conflicts of interest, plagiarism and authorship designation, and the role of science in formulating social policy. This course is designed for graduate students, post-docs and regular faculty in the sciences.
Research Administration Training Series (RATS)
Topics include research data management, research impact, research integrity, publishing, etc.

CHPC "How To" Videos
The Center for High Performance Computing has produced a number of short "how to" videos.
Software Carpentry: Lessons
Freely available lessons for Unix Shell, Git, Mercurial, SQL, Python, R, MATLAB, Make, etc.
Data Carpentry: Lessons
Freely available lessons for data wrangling in biology and genomics.
Reproducible Research (on Coursera)
Learn the concepts and tools behind reporting modern data analyses in a reproducible manner.
Tools for Reproducible Research
A course taught by UW-Madison Prof. Karl Broman. All the materials for the class are available online.