2.2 Reproducibility & Replicability

• Replication vs. reproduction (terminology!)
• A crisis… (e.g. Open Science Collaboration 2015)
• Revealing errors (e.g. Psychoticism) but just as important…
• … the criteria of “good” evidence change⁸
• Initiatives such as…
  • ROpenSci
  • Center for Open Science + Open Science Framework
  • Pre-registration (Pros & Cons)
  • Harvard dataverse
• Replication, replication (King 1995)
• Reproducable in 100 years!
• Ideally all stages of the workflow
• Finish reproduction files after publication
• Cache estimations (some contain randomness)!
• Use open-source software (normative/practical)
• Try out this template for R Markdown (P. Bauer 2018)

References

Bauer, Paul. 2018. “Writing a Reproducible Paper in R Markdown,” May.

King, Gary. 1995. “Replication, Replication.” PS, Political Science & Politics 28 (3): 444–52.

Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349 (6251): aac4716.

---

8. See for instance the discussion surrounding the use of p-values/statistical significance(e.g. Gill 1999) and current discussion about post-treatment bias (e.g. G. King 2010a; Acharya, Blackwell, and Sen 2016).↩