Explore chapters and articles related to this topic
Replication and Reproducibility of Research Results
Published in Charles E. Dean, The Skeptical Professional's Guide to Rational Prescribing, 2022
Indeed, the term “replication” was used in a study40 of highly cited research papers in psychiatry that were tracked a decade after publication in order to gauge how the original findings held up. The authors selected 3 general medicine and 5 psychiatry journals with the highest impact factors in the year 2000, and then selected 83 studies that had found effective treatments. Each study had been cited at least 30 times in the 3 years following publication. Only 16 had been replicated, but, in this paper, the term replication was used very loosely. In fact, subsequent investigators had simply addressed the primary clinical question, but had not attempted to reproduce the methodology. Instead, the follow-up studies often had a better design, or similar designs with a larger sample. In any case, another 16 studies were contradicted, and 11 were found to have substantially smaller effect sizes, with the standardized mean differences of the initial studies overestimated by 132%!
The Genetic Basis of NEC Susceptibility
Published in David J. Hackam, Necrotizing Enterocolitis, 2021
Lovya George, Wei Yu, Alain Cuna, Venkatesh Sampath
Adequate sample size is critical. To attain enough power, candidate gene approaches should ideally have hundreds of infants, while genome-wide approaches need thousands. Only a few of the studies published have attempted to adjust for other known NEC risk factors, NEC, or correct for multiple testing across the number of SNPs investigated (26, 77). These limitations greatly increase the risk for type I errors and make interpretation of results difficult. There is also the need for validation of results in replication cohorts and functional studies to explain the underlying mechanisms. Functional studies are especially important in GWAS, where it is essential to determine the significance of identified variants to the pathogenesis. Very few candidate genes in NEC were evaluated again in subsequent studies, and only a few studies had functional tests to support their findings (Table 47.2).
Testing Replication with Small Samples
Published in Rens van de Schoot, Milica Miočević, Small Sample Size Solutions, 2020
Mariëlle Zondervan-Zwijnenburg, Dominique Rijshouwer
For all four replication research questions we recommend statistical methods and apply them to an empirical example. Note that Anderson and Maxwell (2016) also documented replication research questions and associated methods, although not specifically for small samples. In the current chapter, we adopt several suggestions from Anderson and Maxwell (2016) and add more recent methods. -code (R Core Team, 2017) for reproducing all chapter results is provided as Supplementary Material available on the Open Science Framework (https://osf.io/am7pr/). We demonstrate the four replication research methods for the replication of Henderson, De Liver, and Gollwitzer (2008) by Lane and Gazerian (2016). First, we introduce the original study by Henderson et al. and its replication by Lane and Gazerian. This is followed by a discussion of the four replication research questions and their associated methods.
Policy and Scientific Implications of Compromised Replications
Published in Alcoholism Treatment Quarterly, 2022
Leonard A. Jason, Joseph Cotler, Mohammed F. Islam, Ronald Harvey, Bradley Olson
In summary, in this article we have reviewed conceptual and methodological issues that need to be taken into consideration in replication studies. We recommend a) agreeing at the onset of sharing to discussing variables and methods to be used, b) providing time and opportunities for dialogue on substantive and methodological issues before findings are disseminated, c) ensuring that editors and reviewers carefully consider errors in process when evaluating manuscripts describing the use of other’s datasets, and finally, d) providing opportunities for the primary researchers to offer alternative explanations of findings in journal outlets either prior to or after replicator articles are published. Finally, we recommend the use of data sharing agreements that are mutually signed with expectations clearly articulated. Another excellent resource dealing with guidelines for publishing replication studies is available in Economics: The Open Access, Open-Assessment E-Journal (see http://www.economics-ejournal.org/special-areas/replications-1).
Efficacy and safety of amantadine as a treatment for apathy after brain injury: Two single-case experimental design studies
Published in Neuropsychological Rehabilitation, 2022
Peggy Spauwen, Bert Ter Mors, Peter van Harten, Anne-Fleur Domensino, Rudolf Ponds, Caroline van Heugten
Second, as only two SCEDs were performed, we cannot generalize our findings to all individuals with brain injury. In order to achieve good external validity, three direct or systematic replications of the experiment are needed (Barlow et al., 2009; Tate et al., 2013), which means that two direct replications extra are needed, as case 2 in our study can be regarded as a replication of case 1. In addition, the two cases were different with respect to some characteristics including age, motor impairments, occupation, educational level, cognitive problems, and type of brain injury. The differences in response to amantadine between the two cases in the current study (although they were relatively modest) may reflect differences in (some of) these characteristics. Future studies with comparable cases are needed to confirm the results of the current study.
The role of experiential avoidance in the relation between racial discrimination and negative mental health outcomes
Published in Journal of American College Health, 2022
Jennifer H. Martinez, Elizabeth H. Eustis, Natalie Arbid, Jessica R. Graham-LoPresti, Lizabeth Roemer
Consistent with our first hypothesis, results indicate that both frequency and stress appraisal of racial discrimination were significantly and positively associated with measures of depression, anxious arousal, and general anxiety. These findings are consistent with previous studies that found significant associations between racial discrimination and mental health difficulties.44 Further, we found that appraised stress of discriminatory events, but not frequency of discriminatory events, was positively correlated with EA. Perhaps appraised stress of an event, as opposed to the occurrence of an event, evokes stronger internal responses, and consequently elicits experiential avoidance. Conversely, habitual experiential avoidance could heighten appraisals of stress. Although frequency was significantly correlated with appraised stress of discrimination, the strength of the association was moderate, suggesting that increased frequency was not consistently related to increased stressfulness of discrimination. Further research is needed to explore replication in other samples.