7.1 Reproducibility & Replicability

• Replication, replication (King 1995)
• Replication vs. reproduction (terminology!)
  • Reproduce with study’s data and replicate with new data!
• A crisis… (e.g. Open Science Collaboration 2015)
• Revealing errors (e.g. Psychoticism) but just as important…
• … the criteria of “good” evidence change⁵
• Initiatives such as…
  • ROpenSci
  • Center for Open Science + Open Science Framework
  • Pre-registration (Pros & Cons)
  • Harvard dataverse

References

King, Gary. 1995. “Replication, Replication.” PS, Political Science & Politics 28 (3): 444–52.

Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349 (6251). American Association for the Advancement of Science: aac4716.

---

5. See for instance the discussion surrounding the use of p-values/statistical significance(e.g. Gill 1999) and current discussion about post-treatment bias (e.g. King 2010; Acharya, Blackwell, and Sen 2016).↩