Skip to main content

Doing Meta-Analysis in R: A Hands-on Guide

References


Aaron, Bruce, Jeffrey D Kromrey, and John Ferron. 1998. “Equating \(r\)-Based and \(d\)-Based Effect Size Indices: Problems with a Commonly Recommended Formula.” https://files.eric.ed.gov/fulltext/ED433353.pdf; ERIC. https://files.eric.ed.gov/fulltext/ED433353.pdf.
Adler, Robert A. 2014. “Osteoporosis in Men: A Review.” Bone Research 2: 14001.
Aert, Robbie CM van, Jelte M Wicherts, and Marcel ALM van Assen. 2016. “Conducting Meta-Analyses Based on \(p\) Values: Reservations and Recommendations for Applying p-Uniform and p-Curve.” Perspectives on Psychological Science 11 (5).
Alexander, Ralph A, Michael J Scozzaro, and Lawrence J Borodkin. 1989. “Statistical and Empirical Examination of the Chi-Square Test for Homogeneity of Correlations in Meta-Analysis.” Psychological Bulletin 106 (2): 329.
Altman, Douglas G, and J Martin Bland. 2011. “How to Obtain the Confidence Interval from a \(P\) Value.” BMJ 343: d2090.
Appelbaum, Mark, Harris Cooper, Rex B Kline, Evan Mayo-Wilson, Arthur M Nezu, and Stephen M Rao. 2018. “Journal Article Reporting Standards for Quantitative Research in Psychology: The APA Publications and Communications Board Task Force Report.” American Psychologist 73 (1): 3.
Aronow, Peter M, and Benjamin T Miller. 2019. Foundations of Agnostic Statistics. Cambridge University Press.
Assink, Mark, Carlijn JM Wibbelink, et al. 2016. “Fitting Three-Level Meta-Analytic Models in r: A Step-by-Step Tutorial.” The Quantitative Methods for Psychology 12 (3): 154–74.
Bakbergenuly, Ilyas, David C Hoaglin, and Elena Kulinskaya. 2020. “Methods for Estimating Between-Study Variance and Overall Effect in Meta-Analysis of Odds Ratios.” Research Synthesis Methods 11 (3): 426–42.
Bakbergenuly, Ilyas, and Elena Kulinskaya. 2018. “Meta-Analysis of Binary Outcomes via Generalized Linear Mixed Models: A Simulation Study.” BMC Medical Research Methodology 18 (1): 70.
Balduzzi, Sara, Gerta Rücker, and Guido Schwarzer. 2019. “How to Perform a Meta-Analysis with r: A Practical Tutorial.” Evidence-Based Mental Health 22 (4): 153–60.
Bauer, Daniel J. 2003. “Estimating Multilevel Linear Models as Structural Equation Models.” Journal of Educational and Behavioral Statistics 28 (2): 135–67.
Baujat, Bertrand, Cédric Mahé, Jean-Pierre Pignon, and Catherine Hill. 2002. “A Graphical Method for Exploring Heterogeneity in Meta-Analyses: Application to a Meta-Analysis of 65 Trials.” Statistics in Medicine 21 (18): 2641–52.
Beck, Aaron T, Robert A Steer, and Gregory Brown. 1996. “Beck Depression Inventory–II.” Psychological Assessment.
Becker, Betsy Jane. 1988. “Synthesizing Standardized Mean-Change Measures.” British Journal of Mathematical and Statistical Psychology 41 (2): 257–78.
Bellhouse, David R et al. 2004. “The Reverend Thomas Bayes, FRS: A Biography to Celebrate the Tercentenary of His Birth.” Statistical Science 19 (1): 3–43.
Bender, Ralf, and Lars Beckmann. 2019. “Limitations of the Incidence Density Ratio as Approximation of the Hazard Ratio.” Trials 20 (1): 1–8.
Berlin, Jesse A, and Elliott M Antman. 1994. “Advantages and Limitations of Metaanalytic Regressions of Clinical Trials Data.” The Online Journal of Current Clinical Trials.
Betancourt, Michael, and Mark Girolami. 2015. “Hamiltonian Monte Carlo for Hierarchical Models.” In Current Trends in Bayesian Methodology with Applications, edited by SK Upadhyay, U Singh, DK Dey, and A Loganathan. Chapman & Hall/CRC Press.
Björk, Bo-Christer, Annikki Roos, and Mari Lauri. 2008. “Global Annual Volume of Peer Reviewed Scholarly Articles and the Share Available via Different Open Access Options.” In Proceedings ELPUB 2008 Conference on Electronic Publishing, 178–86.
Bonett, Douglas G. 2020. “Point-Biserial Correlation: Interval Estimation, Hypothesis Testing, Meta-Analysis, and Sample Size Determination.” British Journal of Mathematical and Statistical Psychology 73: 113–44.
Borenstein, Michael, Larry V Hedges, Julian PT Higgins, and Hannah R Rothstein. 2011. Introduction to Meta-Analysis. John Wiley & Sons.
Borenstein, Michael, and Julian PT Higgins. 2013. “Meta-Analysis and Subgroups.” Prevention Science 14 (2): 134–43.
Borenstein, Michael, Julian PT Higgins, Larry V Hedges, and Hannah R Rothstein. 2017. “Basics of Meta-Analysis: \(I^2\) Is Not an Absolute Measure of Heterogeneity.” Research Synthesis Methods 8 (1): 5–18.
Bradburn, Michael J, Jonathan J Deeks, Jesse A Berlin, and A Russell Localio. 2007. “Much Ado about Nothing: A Comparison of the Performance of Meta-Analytical Methods with Rare Events.” Statistics in Medicine 26 (1): 53–77.
Bramer, Wichor M, Gerdien B de Jonge, Melissa L Rethlefsen, Frans Mast, and Jos Kleijnen. 2018. “A Systematic Approach to Searching: An Efficient and Complete Method to Develop Literature Searches.” Journal of the Medical Library Association: JMLA 106 (4): 531.
Breiman, Leo. 2001. “Statistical Modeling: The Two Cultures (with Comments and a Rejoinder by the Author).” Statistical Science 16 (3): 199–231.
Browne, MW, and R Cudeck. 1993. “Alternative Ways of Assessing Model Fit.” In Testing Structural Equation Models, edited by KA Bollen and JS Long. Sage Publications.
Bürkner, Paul-Christian. 2017a. “Advanced Bayesian Multilevel Modeling with the r Package Brms.” ArXiv Preprint 1705.11123.
———. 2017b. “Brms: An r Package for Bayesian Multilevel Models Using Stan.” Journal of Statistical Software, Articles 80 (1): 1–28.
Büscher, Rebekka, Michelle Torok, and Lasse Sander. 2019. “The Effectiveness of Internet-Based Self-Help Interventions to Reduce Suicidal Ideation: Protocol for a Systematic Review and Meta-Analysis.” JMIR Research Protocols 8 (7): e14174.
Campbell Collaboration. 2016. “Methodological Expectations of Campbell Collaboration Intervention Reviews (MECCIR): Conduct Standards.” Campbell Policies and Guidelines Series. https://onlinelibrary.wiley.com/page/journal/18911803/homepage/author-guidelines.
Carter, Evan C, Felix D Schönbrodt, Will M Gervais, and Joseph Hilgard. 2019. “Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods.” Advances in Methods and Practices in Psychological Science 2 (2): 115–44.
Chan, An-Wen, Fujian Song, Andrew Vickers, Tom Jefferson, Kay Dickersin, Peter C Gøtzsche, Harlan M Krumholz, Davina Ghersi, and H Bart Van Der Worp. 2014. “Increasing Value and Reducing Waste: Addressing Inaccessible Research.” The Lancet 383 (9913): 257–66.
Chatfield, Chris. 1995. “Model Uncertainty, Data Mining and Statistical Inference.” Journal of the Royal Statistical Society: Series A (Statistics in Society) 158 (3): 419–44.
Cheung, Mike. 2008. “A Model for Integrating Fixed-, Random-, and Mixed-Effects Meta-Analyses into Structural Equation Modeling.” Psychological Methods 13 (3): 182.
———. 2014. “Modeling Dependent Effect Sizes with Three-Level Meta-Analyses: A Structural Equation Modeling Approach.” Psychological Methods 19 (2): 211.
———. 2015a. Meta-Analysis: A Structural Equation Modeling Approach. John Wiley & Sons.
———. 2015b. “metaSEM: An r Package for Meta-Analysis Using Structural Equation Modeling.” Frontiers in Psychology 5: 1521.
Cheung, Mike, and Wai Chan. 2009. “A Two-Stage Approach to Synthesizing Covariance Matrices in Meta-Analytic Structural Equation Modeling.” Structural Equation Modeling: A Multidisciplinary Journal 16 (1): 28–53.
Christensen, Palle Mark, and Ivar Sønbø Kristiansen. 2006. “Number-Needed-to-Treat (NNT)–Needs Treatment with Care.” Basic & Clinical Pharmacology & Toxicology 99 (1): 12–16.
Chung, Yeojin, Sophia Rabe-Hesketh, Vincent Dorie, Andrew Gelman, and Jingchen Liu. 2013. “A Nondegenerate Penalized Likelihood Estimator for Variance Parameters in Multilevel Models.” Psychometrika 78 (4): 685–709.
Cipriani, Andrea, Julian PT Higgins, John R Geddes, and Georgia Salanti. 2013. “Conceptual and Technical Challenges in Network Meta-Analysis.” Annals of Internal Medicine 159 (2): 130–37.
Cochran, William G. 1954. “Some Methods for Strengthening the Common \(\chi^2\) Tests.” Biometrics 10 (4): 417–51.
Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences. Erlbaum Press.
Cohen, Jacob. 1994. “The Earth Is Round (\(p<.05\)).” American Psychologist 49 (12): 997.
Cousineau, Denis. 2020. “Approximating the Distribution of Cohen’s \(d_p\) in Within-Subject Designs.” Quant. Methods Psychol 16: 418–21.
Cousineau, Denis, and Jean-Christophe Goulet-Pelletier. 2021. “A Study of Confidence Intervals for Cohen’s \(d_p\) in Within-Subject Designs with New Proposals.” In Quant. Methods Psychol, 17:51–75.
Csardi, Gabor, and Tamas Nepusz. 2006. “The Igraph Software Package for Complex Network Research.” InterJournal Complex Systems: 1695. https://igraph.org.
Cuijpers, Pim. 2016. “Meta-Analyses in Mental Health Research. A Practical Guide.” Amsterdam, the Netherlands: Pim Cuijpers Uitgeverij.
Cuijpers, Pim, Mirjam Reijnders, and Marcus JH Huibers. 2019. “The Role of Common Factors in Psychotherapy Outcomes.” Annual Review of Clinical Psychology 15: 207–31.
Cuijpers, Pim, and Filip Smit. 2002. “Excess Mortality in Depression: A Meta-Analysis of Community Studies.” Journal of Affective Disorders 72 (3): 227–36.
Cuijpers, Pim, Erick H Turner, Sander L Koole, Annemiek Van Dijke, and Filip Smit. 2014. “What Is the Threshold for a Clinically Relevant Effect? The Case of Major Depressive Disorders.” Depression and Anxiety 31 (5): 374–78.
Cuijpers, Pim, E Weitz, IA Cristea, and J Twisk. 2017. “Pre-Post Effect Sizes Should Be Avoided in Meta-Analyses.” Epidemiology and Psychiatric Sciences 26 (4): 364–68.
Cuijpers, P, E Karyotaki, M Reijnders, and DD Ebert. 2019. “Was Eysenck Right After All? A Reassessment of the Effects of Psychotherapy for Adult Depression.” Epidemiology and Psychiatric Sciences 28 (1): 21–30.
Cuijpers, P, H Noma, E Karyotaki, A Cipriani, and T Furukawa. 2019. “Effectiveness and Acceptability of Cognitive Behavior Therapy Delivery Formats in Adults with Depression: A Network Meta-Analysis.” JAMA Psychiatry 76 (7): 700–707.
Cummings, Steven R, Warren S Browner, and Stephen B Hulley. 2013. “Conceiving the Research Question and Developing the Study Plan.” Designing Clinical Research 4: 14–22.
Dahlke, Jeffrey A., and Brenton M. Wiernik. 2019. “psychmeta: An r Package for Psychometric Meta-Analysis.” Applied Psychological Measurement 43 (5): 415–16.
Dechartres, Agnes, Ignacio Atal, Carolina Riveros, Joerg Meerpohl, and Philippe Ravaud. 2018. “Association Between Publication Characteristics and Treatment Effect Estimates: A Meta-Epidemiologic Study.” Annals of Internal Medicine 169 (6): 385–93.
DerSimonian, Rebecca, and Nan Laird. 1986. “Meta-Analysis in Clinical Trials.” Controlled Clinical Trials 7 (3): 177–88.
Dias, Sofia, Anthony E Ades, Nicky J Welton, Jeroen P Jansen, and Alexander J Sutton. 2018. Network Meta-Analysis for Decision-Making. John Wiley & Sons.
Dias, Sofia, Alex J Sutton, AE Ades, and Nicky J Welton. 2013. “Evidence Synthesis for Decision Making 2: A Generalized Linear Modeling Framework for Pairwise and Network Meta-Analysis of Randomized Controlled Trials.” Medical Decision Making 33 (5): 607–17.
Dias, Sofia, Nicky J Welton, DM Caldwell, and Anthony E Ades. 2010. “Checking Consistency in Mixed Treatment Comparison Meta-Analysis.” Statistics in Medicine 29 (7-8): 932–44.
DiCiccio, Thomas J, and Bradley Efron. 1996. “Bootstrap Confidence Intervals.” Statistical Science, 189–212.
Duval, Sue, and Richard Tweedie. 2000. “Trim and Fill: A Simple Funnel-Plot–Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis.” Biometrics 56 (2): 455–63.
Ebrahim, Shanil, Sheena Bance, Abha Athale, Cindy Malachowski, and John PA Ioannidis. 2016. “Meta-Analyses with Industry Involvement Are Massively Published and Report No Caveats for Antidepressants.” Journal of Clinical Epidemiology 70: 155–63.
Edwards, SJ, MJ Clarke, S Wordsworth, and J Borrill. 2009. “Indirect Comparisons of Treatments Based on Systematic Reviews of Randomised Controlled Trials.” International Journal of Clinical Practice 63 (6): 841–54.
Efthimiou, Orestis. 2018. “Practical Guide to the Meta-Analysis of Rare Events.” Evidence-Based Mental Health 21 (2): 72–76.
Efthimiou, Orestis, Thomas PA Debray, Gert van Valkenhoef, Sven Trelle, Klea Panayidou, Karel GM Moons, Johannes B Reitsma, Aijing Shang, Georgia Salanti, and GetReal Methods Review Group. 2016. “GetReal in Network Meta-Analysis: A Review of the Methodology.” Research Synthesis Methods 7 (3): 236–63.
Egger, Matthias, George Davey Smith, Martin Schneider, and Christoph Minder. 1997. “Bias in Meta-Analysis Detected by a Simple, Graphical Test.” BMJ 315 (7109): 629–34.
Elwood, Peter. 2006. “The First Randomized Trial of Aspirin for Heart Attack and the Advent of Systematic Overviews of Trials.” Journal of the Royal Society of Medicine 99 (11): 586–88.
Epskamp, Sacha. 2019. “semPlot: Path Diagrams and Visual Analysis of Various SEM Packages’ Output. R Package Version 1.1.2.” https://CRAN.R-project.org/package=semPlot.
Etz, Alexander. 2018. “Introduction to the Concept of Likelihood and Its Applications.” Advances in Methods and Practices in Psychological Science 1 (1): 60–69.
Eysenck, Hans J. 1978. “An Exercise in Mega-Silliness.” American Psychologist 33 (5).
Fanelli, Daniele. 2012. “Negative Results Are Disappearing from Most Disciplines and Countries.” Scientometrics 90 (3): 891–904.
Fisher, Ronald A. 1935. The Design of Experiments. Oliver & Boyd, Edinburgh, UK.
Fisher, Zachary, Elizabeth Tipton, and Hou Zhipeng. 2017. Robumeta: Robust Variance Meta-Regression. https://CRAN.R-project.org/package=robumeta.
Follmann, Dean A, and Michael A Proschan. 1999. “Valid Inference in Random Effects Meta-Analysis.” Biometrics 55 (3): 732–37.
Fraley, Chris, and Adrian E Raftery. 2002. “Model-Based Clustering, Discriminant Analysis, and Density Estimation.” Journal of the American Statistical Association 97 (458): 611–31.
Friese, Malte, David D Loschelder, Karolin Gieseler, Julius Frankenbach, and Michael Inzlicht. 2019. “Is Ego Depletion Real? An Analysis of Arguments.” Personality and Social Psychology Review 23 (2): 107–31.
Furukawa, Toshi A, and Stefan Leucht. 2011. “How to Obtain NNT from Cohen’s \(d\): Comparison of Two Methods.” PLOS ONE 6 (4): e19070.
Furukawa, Toshi A, Hugh McGuire, and Corrado Barbui. 2003. “Low Dosage Tricyclic Antidepressants for Depression.” Cochrane Database of Systematic Reviews, no. 3.
Furukawa, Toshi A, Mirjam Reijnders, Sanae Kishimoto, Masatsugu Sakata, Robert J DeRubeis, Sona Dimidjian, David JA Dozois, et al. 2020. “Translating the BDI and BDI-II into the HAMD and Vice Versa with Equipercentile Linking.” Epidemiology and Psychiatric Sciences 29.
Gart, John J, and James R Zweifel. 1967. “On the Bias of Various Estimators of the Logit and Its Variance with Application to Quantal Bioassay.” Biometrika, 181–87.
Gasparrini, A., B. Armstrong, and M. G. Kenward. 2012. “Multivariate Meta-Analysis for Non-Linear and Other Multi-Parameter Associations.” Statistics in Medicine 31 (29): 3821–39.
Gigerenzer, G. 2004. “Mindless Statistics.” The Journal of Socio-Economics 33 (5): 587–606.
Glass, Gene V. 1976. “Primary, Secondary, and Meta-Analysis of Research.” Educational Researcher 5 (10): 3–8.
Good, Phillip. 2013. Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses. Springer Science & Business.
Greco, T, A Zangrillo, G Biondi-Zoccai, and G Landoni. 2013. “Meta-Analysis: Pitfalls and Hints.” Heart, Lung and Vessels 5 (4): 219.
Grolemund, Garrett. 2014. Hands-on Programming with r: Write Your Own Functions and Simulations. O’Reilly.
Haddaway, Neil R, and Luke A McGuinness. 2020. “PRISMA2020: R Package and ShinyApp for Producing PRISMA 2020 Compliant Flow Diagrams (Version 0.0.1).” http://doi.org/10.5281/zenodo.4287835.
Hamberg, Katarina. 2008. “Gender Bias in Medicine.” Women’s Health 4 (3): 237–43.
Harrer, Mathias, Sophia H Adam, Eva-Maria Messner, Harald Baumeister, Pim Cuijpers, Ronny Bruffaerts, Randy P Auerbach, et al. 2020. “Prevention of Eating Disorders at Universities: A Systematic Review and Meta-Analysis.” International Journal of Eating Disorders 53 (3): 823–33.
Hartigan, John A, and Manchek A Wong. 1979. “Algorithm AS 136: A \(k\)-Means Clustering Algorithm.” Journal of the Royal Statistical Society. Series C (Applied Statistics) 28 (1): 100–108.
Hartung, Joachim. 1999. “An Alternative Method for Meta-Analysis.” Biometrical Journal: Journal of Mathematical Methods in Biosciences 41 (8): 901–16.
Hartung, Joachim, and Guido Knapp. 2001a. “A Refined Method for the Meta-Analysis of Controlled Clinical Trials with Binary Outcome.” Statistics in Medicine 20 (24): 3875–89.
———. 2001b. “On Tests of the Overall Treatment Effect in Meta-Analysis with Normally Distributed Responses.” Statistics in Medicine 20 (12): 1771–82.
Hedges, Larry V. 1981. “Distribution Theory for Glass’s Estimator of Effect Size and Related Estimators.” Journal of Educational Statistics 6 (2): 107–28.
———. 1984. “Estimation of Effect Size Under Nonrandom Sampling: The Effects of Censoring Studies Yielding Statistically Insignificant Mean Differences.” Journal of Educational Statistics 9 (1): 61–85.
———. 1992. “Modeling Publication Selection Effects in Meta-Analysis.” Statistical Science 7 (2): 246–55.
Hedges, Larry V, and Therese D Pigott. 2001. “The Power of Statistical Tests in Meta-Analysis.” Psychological Methods 6 (3): 203.
———. 2004. “The Power of Statistical Tests for Moderators in Meta-Analysis.” Psychological Methods 9 (4): 426.
Hedges, Larry V, and Jack L Vevea. 1996. “Estimating Effect Size Under Publication Bias: Small Sample Properties and Robustness of a Random Effects Selection Model.” Journal of Educational and Behavioral Statistics 21 (4): 299–332.
———. 1998. “Fixed-and Random-Effects Models in Meta-Analysis.” Psychological Methods 3 (4): 486.
Hedges, Larry, and Ingram Olkin. 2014. Statistical Methods for Meta-Analysis. Academic Press.
Hedges, Larry, Elizabeth Tipton, and Matthew Johnson. 2010. “Robust Variance Estimation in Meta-Regression with Dependent Effect Size Estimates.” Research Synthesis Methods 1 (1): 39–65.
Henrich, Joseph, Steven J Heine, and Ara Norenzayan. 2010. “Most People Are Not WEIRD.” Nature 466 (7302): 29.
Higgins, J, D Jackson, JK Barrett, G Lu, AE Ades, and IR White. 2012. “Consistency and Inconsistency in Network Meta-Analysis: Concepts and Models for Multi-Arm Studies.” Research Synthesis Methods 3 (2): 98–110.
Higgins, JPT, and SG Thompson. 2004. “Controlling the Risk of Spurious Findings from Meta-Regression.” Statistics in Medicine 23 (11): 1663–82.
Higgins, J, S Thompson, J Deeks, and D Altman. 2002. “Statistical Heterogeneity in Systematic Reviews of Clinical Trials: A Critical Appraisal of Guidelines and Practice.” Journal of Health Services Research Policy 7 (1): 51–61.
Higgins, Julian PT, and Simon G Thompson. 2002. “Quantifying Heterogeneity in a Meta-Analysis.” Statistics in Medicine 21 (11): 1539–58.
Higgins, Julian, Douglas G Altman, Peter C Gøtzsche, Peter Jüni, David Moher, Andrew D Oxman, Jelena Savović, Kenneth F Schulz, Laura Weeks, and Jonathan AC Sterne. 2011. “The Cochrane Collaboration’s Tool for Assessing Risk of Bias in Randomised Trials.” BMJ 343: d5928.
Higgins, Julian, James Thomas, Jacqueline Chandler, Miranda Cumpston, Tianjing Li, Matthew J Page, and Vivian A Welch. 2019. Cochrane Handbook for Systematic Reviews of Interventions. John Wiley & Sons.
Higgins, Julian, Simon G Thompson, and David J Spiegelhalter. 2009. “A Re-Evaluation of Random-Effects Meta-Analysis.” Journal of the Royal Statistical Society: Series A (Statistics in Society) 172 (1): 137–59.
Hoaglin, David C. 2016. “Misunderstandings about \(Q\) and ‘Cochran’s \(Q\) Test’ in Meta-Analysis.” Statistics in Medicine 35 (4): 485–95.
Hoenig, John M, and Dennis M Heisey. 2001. “The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis.” The American Statistician 55 (1): 19–24.
Hoffman, Matthew D, and Andrew Gelman. 2014. “The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo.” Journal of Machine Learning Research 15 (1): 1593–623.
Hohn, Richard E, Kathleen L Slaney, and Donna Tafreshi. 2019. “Primary Study Quality in Psychological Meta-Analyses: An Empirical Assessment of Recent Practice.” Frontiers in Psychology 9: 2667.
Hough, Susan L, and Bruce W Hall. 1994. “Comparison of the Glass and Hunter-Schmidt Meta-Analytic Techniques.” The Journal of Educational Research 87 (5): 292–96.
Hunter, John E, and Frank L Schmidt. 2004. Methods of Meta-Analysis: Correcting Error and Bias in Research Findings. Sage.
Hutton, Jane L. 2010. “Misleading Statistics.” Pharmaceutical Medicine 24 (3): 145–49.
Infanger, Denis, and Arno Schmidt-Trucksäss. 2019. “\(P\) Value Functions: An Underused Method to Present Research Results and to Promote Quantitative Reasoning.” Statistics in Medicine 38 (21): 4189–97.
Iniesta, R, D Stahl, and P McGuffin. 2016. “Machine Learning, Statistical Learning and the Future of Biological Research in Psychiatry.” Psychological Medicine 46 (12): 2455–65.
IntHout, Joanna, John PA Ioannidis, and George F Borm. 2014. “The Hartung-Knapp-Sidik-Jonkman Method for Random Effects Meta-Analysis Is Straightforward and Considerably Outperforms the Standard DerSimonian-Laird Method.” BMC Medical Research Methodology 14 (1): 25.
IntHout, Joanna, John PA Ioannidis, Maroeska M Rovers, and Jelle J Goeman. 2016. “Plea for Routinely Presenting Prediction Intervals in Meta-Analysis.” BMJ Open 6 (7).
Ioannidis, John PA. 2005. “Why Most Published Research Findings Are False.” PLOS Medicine 2 (8): e124.
———. 2006. “Indirect Comparisons: The Mesh and Mess of Clinical Trials.” The Lancet 368 (9546): 1470–72.
———. 2012. “Why Science Is Not Necessarily Self-Correcting.” Perspectives on Psychological Science 7 (6): 645–54.
———. 2016. “The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-Analyses.” The Milbank Quarterly 94 (3): 485–514.
Iyengar, Satish, and Joel B Greenhouse. 1988. “Selection Models and the File Drawer Problem.” Statistical Science 3 (1): 109–17.
Jackson, Dan. 2013. “Confidence Intervals for the Between-Study Variance in Random Effects Meta-Analysis Using Generalised Cochran Heterogeneity Statistics.” Research Synthesis Methods 4 (3): 220–29.
Jackson, Dan, Ian R White, and Richard D Riley. 2013. “A Matrix-Based Method of Moments for Fitting the Multivariate Random Effects Model for Meta-Analysis and Meta-Regression.” Biometrical Journal 55 (2): 231–45.
Jordan, Ashly E, Natalie A Blackburn, Don C Des Jarlais, and Holly Hagan. 2017. “Past-Year Prevalence of Prescription Opioid Misuse Among Those 11 to 30 Years of Age in the United States: A Systematic Review and Meta-Analysis.” Journal of Substance Abuse Treatment 77: 31–37.
Jöreskog, KG, and Dag Sörbom. 2006. “LISREL 8.80. Chicago: Scientific Software International.” Computer Software.
Jørgensen, Lars, Asger S Paludan-Müller, David RT Laursen, Jelena Savović, Isabelle Boutron, Jonathan AC Sterne, Julian PT Higgins, and Asbjørn Hróbjartsson. 2016. “Evaluation of the Cochrane Tool for Assessing Risk of Bias in Randomized Clinical Trials: Overview of Published Comments and Analysis of User Practice in Cochrane and non-Cochrane Reviews.” Systematic Reviews 5 (1): 80.
Joshi, Megha, and James Pustejovsky. 2022. Wildmeta: Cluster Wild Bootstrapping for Meta-Analysis. https://CRAN.R-project.org/package=wildmeta.
Joshi, Megha, James E Pustejovsky, and S Natasha Beretvas. 2021. “Cluster Wild Bootstrapping to Handle Dependent Effect Sizes in Meta-Analysis with a Small Number of Studies.” Research Synthesis Methods.
Kay, Matthew. 2020. “tidybayes: Tidy Data and Geoms for Bayesian Models. R Package Version 2.1.1.” http://mjskay.github.io/tidybayes. https://doi.org/10.5281/zenodo.1308151.
Kerr, Norbert L. 1998. “HARKing: Hypothesizing After the Results Are Known.” Personality and Social Psychology Review 2 (3): 196–217.
Kim, Esther SH, and Venu Menon. 2009. “Status of Women in Cardiovascular Clinical Trials.” Arteriosclerosis, Thrombosis, and Vascular Biology 29 (3): 279–83.
Kirsch, Irving. 2010. The Emperor’s New Drugs: Exploding the Antidepressant Myth. Basic Books.
Kirsch, Irving, Thomas J Moore, Alan Scoboria, and Sarah S Nicholls. 2002. “The Emperor’s New Drugs: An Analysis of Antidepressant Medication Data Submitted to the US Food and Drug Administration.” Prevention & Treatment 5 (1): 23a.
Kline, Rex B. 2015. Principles and Practice of Structural Equation Modeling. Guilford.
Knapp, Guido, and Joachim Hartung. 2003. “Improved Tests for a Random Effects Meta-Regression with a Single Covariate.” Statistics in Medicine 22 (17): 2693–2710.
Koffel, Erin, and David Watson. 2009. “The Two-Factor Structure of Sleep Complaints and Its Relation to Depression and Anxiety.” Journal of Abnormal Psychology 118 (1): 183.
König, Jochem, Ulrike Krahn, and Harald Binder. 2013. “Visualizing the Flow of Evidence in Network Meta-Analysis and Characterizing Mixed Treatment Comparisons.” Statistics in Medicine 32 (30): 5414–29.
Kraemer, Helena Chmura. 2009. “Events Per Person-Time (Incidence Rate): A Misleading Statistic?” Statistics in Medicine 28 (6): 1028–39.
Kraemer, Helena Chmura, and David J Kupfer. 2006. “Size of Treatment Effects and Their Importance to Clinical Research and Practice.” Biological Psychiatry 59 (11): 990–96.
Krahn, Ulrike, Harald Binder, and Jochem König. 2013. “A Graphical Tool for Locating Inconsistency in Network Meta-Analyses.” BMC Medical Research Methodology 13 (1): 35.
Lakens, Daniel, Elizabeth Page-Gould, Marcel ALM van Assen, Bobbie Spellman, Felix Schönbrodt, Fred Hasselman, Katherine S Corker, et al. 2017. “Examining the Reproducibility of Meta-Analyses in Psychology: A Preliminary Report.” https://osf.io/xfbjf/; MetaArXiv.
Langan, Dean, Julian PT Higgins, Dan Jackson, Jack Bowden, Areti Angeliki Veroniki, Evangelos Kontopantelis, Wolfgang Viechtbauer, and Mark Simmonds. 2019. “A Comparison of Heterogeneity Variance Estimators in Simulated Random-Effects Meta-Analyses.” Research Synthesis Methods 10 (1): 83–98.
Lipsey, Mark W, and David B Wilson. 2001. Practical Meta-Analysis. SAGE.
Lu, Guobing, and AE Ades. 2009. “Modeling Between-Trial Variance Structure in Mixed Treatment Comparisons.” Biostatistics 10 (4): 792–805.
Lüdecke, Daniel. 2019. “Esc: Effect Size Computation for Meta Analysis (Version 0.5.1).” https://CRAN.R-project.org/package=esc. https://doi.org/10.5281/zenodo.1249218.
Lunn, David, Chris Jackson, Nicky Best, Andrew Thomas, and David Spiegelhalter. 2012. The BUGS Book: A Practical Introduction to Bayesian Analysis. Chapman & Hall/CRC Press.
Mahood, Quenby, Dwayne Van Eerd, and Emma Irvin. 2014. “Searching for Grey Literature for Systematic Reviews: Challenges and Benefits.” Research Synthesis Methods 5 (3): 221–34.
Makambi, Kepher H. 2004. “The Effect of the Heterogeneity Variance Estimator on Some Tests of Treatment Efficacy.” Journal of Biopharmaceutical Statistics 14 (2): 439–49.
Mansfield, Edward R, and Billy P Helms. 1982. “Detecting Multicollinearity.” The American Statistician 36 (3a): 158–60.
Mantel, Nathan, and William Haenszel. 1959. “Statistical Aspects of the Analysis of Data from Retrospective Studies of Disease.” Journal of the National Cancer Institute 22 (4): 719–48.
Marsman, Maarten, Felix D Schönbrodt, Richard D Morey, Yuling Yao, Andrew Gelman, and Eric-Jan Wagenmakers. 2017. “A Bayesian Bird’s Eye View of ‘Replications of Important Results in Social Psychology’.” Royal Society Open Science 4 (1): 160426.
Mattos, Claudia Trindade, and Antônio Carlos de Oliveira Ruellas. 2015. “Systematic Review and Meta-Analysis: What Are the Implications in the Clinical Practice?” Dental Press Journal of Orthodontics 20 (1): 17–19.
Mbuagbaw, L, B Rochwerg, R Jaeschke, D Heels-Andsell, W Alhazzani, L Thabane, and Gordon H Guyatt. 2017. “Approaches to Interpreting and Choosing the Best Treatments in Network Meta-Analyses.” Systematic Reviews 6 (1): 1–5.
McArdle, J Jack, and Roderick P McDonald. 1984. “Some Algebraic Properties of the Reticular Action Model for Moment Structures.” British Journal of Mathematical and Statistical Psychology 37 (2): 234–51.
McAuley, Laura, Peter Tugwell, David Moher, et al. 2000. “Does the Inclusion of Grey Literature Influence Estimates of Intervention Effectiveness Reported in Meta-Analyses?” The Lancet 356 (9237): 1228–31.
McGrayne, Sharon Bertsch. 2011. The Theory That Would Not Die: How Bayes’ Rule Cracked the Enigma Code, Hunted down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy. Yale University Press.
McGuinness, Luke A. 2019. “Robvis: An r Package and Web Application for Visualising Risk-of-Bias Assessments.” https://github.com/mcguinlu/robvis. https://github.com/mcguinlu/robvis.
McGuinness, Luke A, and Julian PT Higgins. 2020. “Risk-Of-Bias VISualization (Robvis): An r Package and Shiny Web App for Visualizing Risk-of-Bias Assessments.” Research Synthesis Methods 12 (1).
McNeish, Daniel. 2016. “On Using Bayesian Methods to Address Small Sample Problems.” Structural Equation Modeling: A Multidisciplinary Journal 23 (5): 750–73.
McNutt, Marcia. 2014. “Reproducibility.” Science 343 (6168): 229.
McShane, Blakeley B, Ulf Böckenholt, and Karsten T Hansen. 2016. “Adjusting for Publication Bias in Meta-Analysis: An Evaluation of Selection Methods and Some Cautionary Notes.” Perspectives on Psychological Science 11 (5): 730–49.
Meehl, Paul E. 1978. “Theoretical Risks and Tabular Asterisks: Sir Karl, Sir Ronald, and the Slow Progress of Soft Psychology.” Journal of Consulting and Clinical Psychology 46 (4): 806.
Mehta, Paras D, and Michael C Neale. 2005. “People Are Variables Too: Multilevel Structural Equations Modeling.” Psychological Methods 10 (3): 259.
Mendes, Diogo, Carlos Alves, and Francisco Batel-Marques. 2017. “Number needed to treat (NNT) in Clinical Literature: An Appraisal.” BMC Medicine 15 (1): 112.
Moher, David, Alessandro Liberati, Jennifer Tetzlaff, Douglas G Altman, Prisma Group, et al. 2009. “Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement.” PLoS Medicine 6 (7).
Moher, David, Larissa Shamseer, Mike Clarke, Davina Ghersi, Alessandro Liberati, Mark Petticrew, Paul Shekelle, Lesley A Stewart, and PRISMA-P Group. 2015. “Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 Statement.” Systematic Reviews 4 (1): 1.
Møller, Anders Pape, and Timothy A Mousseau. 2015. “Strong Effects of Ionizing Radiation from Chernobyl on Mutation Rates.” Scientific Reports 5: 8363.
Montgomery, Douglas C. 2013. Design and Analysis of Experiments. 8th ed. Hoboken, NJ: Wiley.
Mosca, Lori, Gmerice Hammond, Heidi Mochari-Greenberger, Amytis Towfighi, and Michelle A Albert. 2013. “Fifteen-Year Trends in Awareness of Heart Disease in Women: Results of a 2012 American Heart Association National Survey.” Circulation 127 (11): 1254–63.
Muthén, Linda K, and Bengt O Muthén. 2012. “MPlus: Statistical Analysis with Latent Variables–User’s Guide.” Citeseer.
Ngamaba, Kayonda Hubert, Maria Panagioti, and Christopher J Armitage. 2017. “How Strongly Related Are Health Status and Subjective Well-Being? Systematic Review and Meta-Analysis.” The European Journal of Public Health 27 (5): 879–85.
Nielsen, Mathias Wullum, Jens Peter Andersen, Londa Schiebinger, and Jesper W Schneider. 2017. “One and a Half Million Medical Papers Reveal a Link Between Author Gender and Attention to Gender and Sex Analysis.” Nature Human Behaviour 1 (11): 791–96.
Nuzzo, Rigina. 2014. “Statistical Errors: \(P\) Values, the ’Gold Standard’ of Statistical Validity, Are Not as Reliable as Many Scientists Assume.” Nature 506 (7487): 150–53.
O’Rourke, Keith. 2007. “An Historical Perspective on Meta-Analysis: Dealing Quantitatively with Varying Study Results.” Journal of the Royal Society of Medicine 100 (12): 579–82.
Olkin, Ingram, Issa J Dahabreh, and Thomas A Trikalinos. 2012. “GOSH–a Graphical Display of Study Heterogeneity.” Research Synthesis Methods 3 (3): 214–23.
Olkin, Ingram, and Jeremy D Finn. 1995. “Correlations Redux.” Psychological Bulletin 118 (1): 155.
Open Science Collaboration et al. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349 (6251).
Page, Matthew J, David Moher, Patrick M Bossuyt, Isabelle Boutron, Tammy C Hoffmann, Cynthia D Mulrow, Larissa Shamseer, et al. 2021. “PRISMA 2020 Explanation and Elaboration: Updated Guidance and Exemplars for Reporting Systematic Reviews.” BMJ 372. https://www.bmj.com/content/372/bmj.n71.
Page, Matthew J, Jonathan AC Sterne, Julian PT Higgins, and Matthias Egger. 2020. “Investigating and Dealing with Publication Bias and Other Reporting Biases in Meta-Analyses of Health Research: A Review.” Research Synthesis Methods.
Panageas, Katherine S, Leah Ben-Porat, Maura N Dickler, Paul B Chapman, and Deborah Schrag. 2007. “When You Look Matters: The Effect of Assessment Schedule on Progression-Free Survival.” Journal of the National Cancer Institute 99 (6): 428–32.
Parmar, Mahesh KB, Valter Torri, and Lesley Stewart. 1998. “Extracting Summary Statistics to Perform Meta-Analyses of the Published Literature for Survival Endpoints.” Statistics in Medicine 17 (24): 2815–34.
Pastor, Dena A, and Rory A Lazowski. 2018. “On the Multilevel Nature of Meta-Analysis: A Tutorial, Comparison of Software Programs, and Discussion of Analytic Choices.” Multivariate Behavioral Research 53 (1): 74–89.
Patsopoulos, Nikolaos A, Apostolos A Analatos, and John PA Ioannidis. 2005. “Relative Citation Impact of Various Study Designs in the Health Sciences.” JAMA 293 (19): 2362–66.
Paule, Robert C, and John Mandel. 1982. “Consensus Values and Weighting Factors.” Journal of Research of the National Bureau of Standards 87 (5): 377–85.
Peters, Jaime L, Alex J Sutton, David R Jones, Keith R Abrams, and Lesley Rushton. 2006. “Comparison of Two Methods to Detect Publication Bias in Meta-Analysis.” JAMA 295 (6): 676–80.
———. 2007. “Performance of the Trim and Fill Method in the Presence of Publication Bias and Between-Study Heterogeneity.” Statistics in Medicine 26 (25): 4544–62.
———. 2008. “Contour-Enhanced Meta-Analysis Funnel Plots Help Distinguish Publication Bias from Other Causes of Asymmetry.” Journal of Clinical Epidemiology 61 (10): 991–96.
Peterson, Brian G., and Peter Carl. 2020. “PerformanceAnalytics: Econometric Tools for Performance and Risk Analysis. R Package Version 2.0.4.” https://CRAN.R-project.org/package=PerformanceAnalytics.
Peto, R, and S Parish. 1980. “Aspirin After Myocardial Infarction.” The Lancet 1 (8179): 1172–73.
Piantadosi, Steven, David P Byar, and Sylvan B Green. 1988. “The Ecological Fallacy.” American Journal of Epidemiology 127 (5): 893–904.
Pigott, Terri D, and Joshua R Polanin. 2020. “Methodological Guidance Paper: High-Quality Meta-Analysis in a Systematic Review.” Review of Educational Research 90 (1): 24–46.
Plummer, Martyn. 2019. “Rjags: Bayesian Graphical Models Using MCMC. R Package Version 4-10.” https://CRAN.R-project.org/package=rjags. https://CRAN.R-project.org/package=rjags.
Poole, Charles, and Sander Greenland. 1999. “Random-Effects Meta-Analyses Are Not Always Conservative.” American Journal of Epidemiology 150 (5): 469–75.
Pustejovsky, James. 2022. clubSandwich: Cluster-Robust (Sandwich) Variance Estimators with Small-Sample Corrections. https://CRAN.R-project.org/package=clubSandwich.
Pustejovsky, James E, and Melissa A Rodgers. 2019. “Testing for Funnel Plot Asymmetry of Standardized Mean Differences.” Research Synthesis Methods 10 (1): 57–71.
Pustejovsky, James E, and Elizabeth Tipton. 2021. “Meta-Analysis with Robust Variance Estimation: Expanding the Range of Working Models.” Prevention Science, 1–14.
Quintana, Daniel S. 2015. “From Pre-Registration to Publication: A Non-Technical Primer for Conducting a Meta-Analysis to Synthesize Correlational Data.” Frontiers in Psychology 6: 1549.
Raudenbush, SW. 2009. “Analyzing Effect Sizes: Random Effects Models.” In The Handbook of Research Synthesis and Meta-Analysis (2nd Ed.), edited by H Cooper, LV Hedges, and JC Valentine. Russell Sage Foundation.
Riley, Richard D, Paul C Lambert, and Ghada Abo-Zaid. 2010. “Meta-Analysis of Individual Participant Data: Rationale, Conduct, and Reporting.” BMJ 340: c221.
Riley, Richard D, Mark C Simmonds, and Maxime P Look. 2007. “Evidence Synthesis Combining Individual Patient Data and Aggregate Data: A Systematic Review Identified Current Practice and Possible Methods.” Journal of Clinical Epidemiology 60 (5): 431.e1–12.
Riley, Richard D., Jayne F. Tierney, and Lesley A. Stewart. 2021. Individual Participant Data Meta-Analysis: A Handbook for Healthcare Research. 1st ed. Hoboken, New Jersey: Wiley.
Robins, James, Sander Greenland, and Norman E. Breslow. 1986. “A General Estimator for the Variance of the Mantel-Haenszel Odds Ratio.” American Journal of Epidemiology, 719–23.
Rosnow, Ralph L, and Robert Rosenthal. 1996. “Computing Contrasts, Effect Sizes, and Counternulls on Other People’s Published Data: General Procedures for Research Consumers.” Psychological Methods 1 (4): 331.
Rosnow, Ralph L, Robert Rosenthal, and Donald B Rubin. 2000. “Contrasts and Correlations in Effect-Size Estimation.” Psychological Science 11 (6): 446–53.
Rothman, Kenneth J, Sander Greenland, and Timothy L Lash. 2008. Modern Epidemiology. Lippincott Williams & Wilkins.
Rothstein, Hannah R, Alexander J Sutton, and Michael Borenstein. 2005. Publication Bias in Meta-Analysis. Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. John Wiley & Sons.
Röver, Christian. 2017. “Bayesian Random-Effects Meta-Analysis Using the ‘Bayesmeta‘ r Package.” ArXiv Preprint 1711.08683.
Rücker, Gerta. 2012. “Network Meta-Analysis, Electrical Networks and Graph Theory.” Research Synthesis Methods 3 (4): 312–24.
Rücker, Gerta, Ulrike Krahn, Jochem König, Orestis Efthimiou, and Guido Schwarzer. 2020. Netmeta: Network Meta-Analysis Using Frequentist Methods. https://CRAN.R-project.org/package=netmeta. https://CRAN.R-project.org/package=netmeta.
Rücker, Gerta, and Guido Schwarzer. 2015. “Ranking Treatments in Frequentist Network Meta-Analysis Works Without Resampling Methods.” BMC Medical Research Methodology 15 (58).
———. 2021. “Beyond the Forest Plot: The Drapery Plot.” Research Synthesis Methods 12 (1): 13–19.
Rücker, Gerta, Guido Schwarzer, James R Carpenter, Harald Binder, and Martin Schumacher. 2011. “Treatment-Effect Estimates Adjusted for Small-Study Effects via a Limit Meta-Analysis.” Biostatistics 12 (1): 122–42.
Rücker, Gerta, Guido Schwarzer, James R Carpenter, and Martin Schumacher. 2008. “Undue Reliance on \(I^2\) in Assessing Heterogeneity May Mislead.” BMC Medical Research Methodology 8 (1): 79.
Salanti, Georgia, AE Ades, and John PA Ioannidis. 2011. “Graphical Methods and Numerical Summaries for Presenting Results from Multiple-Treatment Meta-Analysis: An Overview and Tutorial.” Journal of Clinical Epidemiology 64 (2): 163–71.
Salanti, Georgia, Cinzia Del Giovane, Anna Chaimani, Deborah M Caldwell, and Julian PT Higgins. 2014. “Evaluating the Quality of Evidence from a Network Meta-Analysis.” PLOS ONE 9 (7): e99682.
Sanderson, Simon, Iain D Tatt, and Julian Higgins. 2007. “Tools for Assessing Quality and Susceptibility to Bias in Observational Studies in Epidemiology: A Systematic Review and Annotated Bibliography.” International Journal of Epidemiology 36 (3): 666–76.
Saruhanjan, Karina, Anna-Carlotta Zarski, Tobias Bauer, Harald Baumeister, Pim Cuijpers, Kai Spiegelhalder, Randy P Auerbach, et al. 2020. “Psychological Interventions to Improve Sleep in College Students: A Meta-Analysis of Randomized Controlled Trials.” Journal of Sleep Research, e13097.
Schauberger, Philipp, and Alexander Walker. 2020. “Openxlsx: Read, Write and Edit Xlsx Files. R Package Version 4.1.5.” https://CRAN.R-project.org/package=openxlsx. https://CRAN.R-project.org/package=openxlsx.
Scherer, Roberta W, Joerg J Meerpohl, Nadine Pfeifer, Christine Schmucker, Guido Schwarzer, and Erik von Elm. 2018. “Full Publication of Results Initially Presented in Abstracts.” Cochrane Database of Systematic Reviews 1 (11).
Schmidt, Frank L, and John E Hunter. 1977. “Development of a General Solution to the Problem of Validity Generalization.” Journal of Applied Psychology 62 (5): 529.
Schmucker, Christine, Lisa K Schell, Susan Portalupi, Patrick Oeller, Laura Cabrera, Dirk Bassler, Guido Schwarzer, et al. 2014. “Extent of Non-Publication in Cohorts of Studies Approved by Research Ethics Committees or Included in Trial Registries.” PLOS ONE 9 (12): e114023.
Schöpfel, Joachim, and Behrooz Rasuli. 2018. “Are Electronic Theses and Dissertations (Still) Grey Literature in the Digital Age? A FAIR Debate.” The Electronic Library 36 (2): 208–19.
Schubert, Erich, Jörg Sander, Martin Ester, Hans Peter Kriegel, and Xiaowei Xu. 2017. “DBSCAN Revisited, Revisited: Why and How You Should (Still) Use DBSCAN.” ACM Transactions on Database Systems (TODS) 42 (3): 1–21.
Schwarzer, Guido, James R. Carpenter, and Gerta Rücker. 2020. “Metasens: Advanced Statistical Methods to Model and Adjust for Bias in Meta-Analysis. R Package Version 0.5-0.” https://CRAN.R-project.org/package=metasens. https://CRAN.R-project.org/package=metasens.
Schwarzer, Guido, James R Carpenter, and Gerta Rücker. 2015. Meta-Analysis with r. Springer.
Schwarzer, Guido, Hiam Chemaitelly, Laith J Abu-Raddad, and Gerta Rücker. 2019. “Seriously Misleading Results Using Inverse of Freeman-Tukey Double Arcsine Transformation in Meta-Analysis of Single Proportions.” Research Synthesis Methods 10 (3): 476–83.
Shadish, William R, and Jesse D Lecy. 2015. “The Meta-Analytic Big Bang.” Research Synthesis Methods 6 (3): 246–64.
Shannon, Harry. 2016. “A Statistical Note on Karl Pearson’s 1904 Meta-Analysis.” Journal of the Royal Society of Medicine 109 (8): 310–11.
Sharpe, Donald. 1997. “Of Apples and Oranges, File Drawers and Garbage: Why Validity Issues in Meta-Analysis Will Not Go Away.” Clinical Psychology Review 17 (8): 881–901.
Shim, Sung Ryul, Seong-Jang Kim, Jonghoo Lee, and Gerta Rücker. 2019. “Network Meta-Analysis: Application and Practice Using r Software.” Epidemiology and Health 41.
Sidik, Kurex, and Jeffrey N Jonkman. 2002. “A Simple Confidence Interval for Meta-Analysis.” Statistics in Medicine 21 (21): 3153–59.
———. 2005. “Simple Heterogeneity Variance Estimation for Meta-Analysis.” Journal of the Royal Statistical Society: Series C (Applied Statistics) 54 (2): 367–84.
———. 2007. “A Comparison of Heterogeneity Variance Estimators in Combining Results of Studies.” Statistics in Medicine 26 (9): 1964–81.
———. 2019. “A Note on the Empirical Bayes Heterogeneity Variance Estimator in Meta-Analysis.” Statistics in Medicine 38 (20): 3804–16.
Silberzahn, Raphael, Eric Luis Uhlmann, Daniel P Martin, Pasquale Anselmi, Frederik Aust, Eli Awtrey, Štěpán Bahnı́k, et al. 2018. “Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results.” Advances in Methods and Practices in Psychological Science 1 (3): 337–56.
Simonsohn, Uri, Leif D Nelson, and Joseph P Simmons. 2014a. “P-Curve and Effect Size: Correcting for Publication Bias Using Only Significant Results.” Perspectives on Psychological Science 9 (6): 666–81.
———. 2014b. “P-Curve: A Key to the File-Drawer.” Journal of Experimental Psychology: General 143 (2): 534.
Simonsohn, Uri, Joseph P Simmons, and Leif D Nelson. 2015. “Better p-Curves: Making p-Curve Analysis More Robust to Errors, Fraud, and Ambitious \(p\)-Hacking, a Reply to Ulrich and Miller (2015).” Journal of Experimental Psychology: General 144 (6): 1146–52.
———. 2020. “Specification Curve Analysis.” Nature Human Behaviour 4 (11): 1208–14.
Smith, Mary L, and Gene V Glass. 1977. “Meta-Analysis of Psychotherapy Outcome Studies.” American Psychologist 32 (9): 752.
Song, Fujian, Yoon K Loke, Tanya Walsh, Anne-Marie Glenny, Alison J Eastwood, and Douglas G Altman. 2009. “Methodological Problems in the Use of Indirect Comparisons for Evaluating Healthcare Interventions: Survey of Published Systematic Reviews.” BMJ 338: b1147.
Spearman, C. 1904. “The Proof and Measurement of Association Between Two Things.” The American Journal of Psychology 15 (1): 72–101.
Stanley, Tom D. 2008. “Meta-Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection.” Oxford Bulletin of Economics and Statistics 70 (1): 103–27.
———. 2017. “Limitations of PET-PEESE and Other Meta-Analysis Methods.” Social Psychological and Personality Science 8 (5): 581–91.
Stanley, Tom D, and Hristos Doucouliagos. 2014. “Meta-Regression Approximations to Reduce Publication Selection Bias.” Research Synthesis Methods 5 (1): 60–78.
Stanley, Tom, Hristos Doucouliagos, and John Ioannidis. 2022. “Beyond Random Effects: When Small-Study Findings Are More Heterogeneous.” Advances in Methods and Practices in Psychological Science 5 (4).
Sterne, Jonathan, David Gavaghan, and Matthias Egger. 2000. “Publication and Related Bias in Meta-Analysis: Power of Statistical Tests and Prevalence in the Literature.” Journal of Clinical Epidemiology 53 (11): 1119–29.
Sterne, Jonathan, Miguel A Hernán, Barnaby C Reeves, Jelena Savović, Nancy D Berkman, Meera Viswanathan, David Henry, et al. 2016. “ROBINS-I: A Tool for Assessing Risk of Bias in Non-Randomised Studies of Interventions.” BMJ 355: i4919.
Sterne, Jonathan, Jelena Savović, Matthew J Page, Roy G Elbers, Natalie S Blencowe, Isabelle Boutron, Christopher J Cates, et al. 2019. “RoB 2: A Revised Tool for Assessing Risk of Bias in Randomised Trials.” BMJ 366.
Sterne, Jonathan, Alex J Sutton, John P A Ioannidis, Norma Terrin, David R Jones, Joseph Lau, James Carpenter, et al. 2011. “Recommendations for Examining and Interpreting Funnel Plot Asymmetry in Meta-Analyses of Randomised Controlled Trials.” BMJ 343.
Stijnen, Theo, Taye H Hamza, and Pinar Özdemir. 2010. “Random Effects Meta-Analysis of Event Outcome in the Framework of the Generalized Linear Mixed Model with Applications in Sparse Data.” Statistics in Medicine 29 (29): 3046–67.
Stinerock, Robert. 2018. Statistics with r: A Beginner’s Guide. 1st ed. London, UK: SAGE.
Sweeting, Michael J, Alexander J Sutton, and Paul C Lambert. 2004. “What to Add to Nothing? Use and Avoidance of Continuity Corrections in Meta-Analysis of Sparse Data.” Statistics in Medicine 23 (9): 1351–75.
Tacconelli, Evelina. 2009. “Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Healthcare.” The Lancet Infectious Diseases 10 (4).
Tamhane, Ashutosh R, Andrew O Westfall, Greer A Burkholder, and Gary R Cutter. 2016. “Prevalence Odds Ratio Versus Prevalence Ratio: Choice Comes with Consequences.” Statistics in Medicine 35 (30): 5730–35.
Tang, Ryan W, and Mike Cheung. 2016. “Testing IB Theories with Meta-Analytic Structural Equation Modeling.” Review of International Business and Strategy 26 (4): 472–92.
Terrin, Norma, Christopher H Schmid, Joseph Lau, and Ingram Olkin. 2003. “Adjusting for Publication Bias in the Presence of Heterogeneity.” Statistics in Medicine 22 (13): 2113–26.
Thalheimer, Will, and Samantha Cook. 2002. How to Calculate Effect Sizes from Published Research: A Simplified Methodology. Vol. 1. http://coshima.davidrjfikis.com/EPRS8530/Effect_Sizes_pdf4.pdf; Work-Learning Research. http://coshima.davidrjfikis.com/EPRS8530/Effect\_Sizes\_pdf4.pdf.
Thompson, Bruce. 2004. Exploratory and Confirmatory Factor Analysis. American Psychological Association.
Thompson, Simon G, and Julian PT Higgins. 2002. “How Should Meta-Regression Analyses Be Undertaken and Interpreted?” Statistics in Medicine 21 (11): 1559–73.
Thompson, Simon G, Rebecca M Turner, and David E Warn. 2001. “Multilevel Models for Meta-Analysis, and Their Application to Absolute Risk Differences.” Statistical Methods in Medical Research 10 (6): 375–92.
Tipton, Elizabeth. 2015. “Small Sample Adjustments for Robust Variance Estimation with Meta-Regression.” Psychological Methods 20 (3): 375.
Tipton, Elizabeth, and James E Pustejovsky. 2015. “Small-Sample Adjustments for Tests of Moderators and Model Fit Using Robust Variance Estimation in Meta-Regression.” Journal of Educational and Behavioral Statistics 40 (6): 604–34.
Tipton, Elizabeth, James E Pustejovsky, and Hedyeh Ahmadi. 2019. “A History of Meta-Regression: Technical, Conceptual, and Practical Developments Between 1974 and 2018.” Research Synthesis Methods 10 (2): 161–79.
Valkenhoef, Gert van, Guobing Lu, Bert de Brock, Hans Hillege, AE Ades, and Nicky J Welton. 2012. “Automating Network Meta-Analysis.” Research Synthesis Methods 3 (4): 285–99.
Valstad, Mathias, Gail A Alvares, Ole A Andreassen, Lars T Westlye, and Daniel S Quintana. 2016. “The Relationship Between Central and Peripheral Oxytocin Concentrations: A Systematic Review and Meta-Analysis Protocol.” Systematic Reviews 5 (1): 1–7.
Vance, Ashlee. 2009. “Data Analysts Captivated by r’s Power.” New York Times. https://www.nytimes.com/2009/01/07/technology/business-computing/07program.html.
Veroniki, Areti Angeliki, Dan Jackson, Wolfgang Viechtbauer, Ralf Bender, Jack Bowden, Guido Knapp, Oliver Kuss, Julian PT Higgins, Dean Langan, and Georgia Salanti. 2016. “Methods to Estimate the Between-Study Variance and Its Uncertainty in Meta-Analysis.” Research Synthesis Methods 7 (1): 55–79.
Vevea, Jack L, and Carol M Woods. 2005. “Publication Bias in Research Synthesis: Sensitivity Analysis Using a Priori Weight Functions.” Psychological Methods 10 (4): 428.
Viechtbauer, Wolfgang. 2005. “Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model.” Journal of Educational and Behavioral Statistics 30 (3): 261–93.
———. 2007a. “Approximate Confidence Intervals for Standardized Effect Sizes in the Two-Independent and Two-Dependent Samples Design.” Journal of Educational and Behavioral Statistics 32: 39–60.
———. 2007b. “Confidence Intervals for the Amount of Heterogeneity in Meta-Analysis.” Statistics in Medicine 26 (1): 37–52.
———. 2010. “Conducting Meta-Analyses in r with the metafor Package.” Journal of Statistical Software 36 (3): 1–48.
Viechtbauer, Wolfgang, and Mike Cheung. 2010. “Outlier and Influence Diagnostics for Meta-Analysis.” Research Synthesis Methods 1 (2): 112–25.
Viechtbauer, Wolfgang, José Antonio López-López, Julio Sánchez-Meca, and Fulgencio Marı́n-Martı́nez. 2015. “A Comparison of Procedures to Test for Moderators in Mixed-Effects Meta-Regression Models.” Psychological Methods 20 (3): 360.
Vuorre, Matti. 2016. “Sometimes i R: Bayesian Meta-Analysis with R, Stan & Brms.” https://mvuorre.github.io/posts/2016-09-29-bayesian-meta-analysis/.
Wampold, Bruce E. 2013. The Great Psychotherapy Debate: Models, Methods, and Findings. Routledge.
Wellek, Stefan. 2017. “A Critical Evaluation of the Current ‘\(p\)-Value Controversy’.” Biometrical Journal 59 (5): 854–72.
Whittingham, Mark J, Philip A Stephens, Richard B Bradbury, and Robert P Freckleton. 2006. “Why Do We Still Use Stepwise Modelling in Ecology and Behaviour?” Journal of Animal Ecology 75 (5): 1182–89.
Wicherts, Jelte M, Coosje LS Veldkamp, Hilde EM Augusteijn, Marjan Bakker, Robbie Van Aert, and Marcel ALM Van Assen. 2016. “Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid \(p\)-Hacking.” Frontiers in Psychology 7: 1832.
Wickham, Hadley, Mara Averick, Jennifer Bryan, Winston Chang, Lucy D’Agostino McGowan, Romain François, Garrett Grolemund, et al. 2019. “Welcome to the tidyverse.” Journal of Open Source Software 4 (43): 1686.
Wickham, Hadley, and Garrett Grolemund. 2016. R for Data Science:import, Tidy, Transform, Visualize, and Model Data. O’Reilly.
Wiksten, Anna, Gerta Rücker, and Guido Schwarzer. 2016. “Hartung–Knapp Method Is Not Always Conservative Compared with Fixed-Effect Meta-Analysis.” Statistics in Medicine 35 (15): 2503–15.
Williams, Donald R, Philippe Rast, and Paul-Christian Bürkner. 2018. “Bayesian Meta-Analysis with Weakly Informative Prior Distributions.” https://psyarxiv.com/7tbrm/; PsyArXiv.
Wolen, Aaron R., Chris H. J. Hartgerink, Ryan Hafen, Brian G. Richards, Courtney K. Soderberg, and Timothy P. York. 2020. “osfr: An r Interface to the Open Science Framework.” Journal of Open Source Software 5 (46): 2071.
Wołodźko, Tymoteusz. 2020. “extraDistr: Additional Univariate and Multivariate Distributions. R Package Version 1.9.1.” https://CRAN.R-project.org/package=extraDistr.
Xie, Yihui, Joseph J Allaire, and Garrett Grolemund. 2018. R Markdown: The Definitive Guide. Chapman; Hall/CRC Press.
Yusuf, Salim, Richard Peto, John Lewis, Rory Collins, and Peter Sleight. 1985. “Beta Blockade During and After Myocardial Infarction: An Overview of the Randomized Trials.” Progress in Cardiovascular Diseases 27 (5): 335–71.
Zhang, Jun, and Kai F. Yu. 1998. “What’s the Relative Risk? A Method of Correcting the Odds Ratio in Cohort Studies of Common Outcomes.” JAMA 280 (19): 1690–91.