Is that government testifying about reliable psychological testimony

Philip D. Cave

Of 100 studies published in top-ranking journals in 2008, 75% of social psychology experiments and half of cognitive studies failed the replication test.

So says a report in The Guardian.

Of 100 studies published in top-ranking journals in 2008, 75% of social psychology experiments and half of cognitive studies failed the replication test.

Here is a link to the actual study: Estimating the reproducibility of psychological science, 349 SCIENCE, 28 August 2015, No. 6251.

RESULTS: We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. There is no single standard for evaluating replication success. Here, we evaluated reproducibility using significance and P values, effect sizes, subjective assessments of replication teams, and meta-analysis of effect sizes. The mean effect size (r) of the replication effects (Mr = 0.197, SD = 0.257) was half the magnitude of the mean effect size of the original effects (Mr = 0.403, SD = 0.188), representing a substantial decline. Ninety-seven percent of original studies had significant results (P < .05). Thirty-six percent of replications had significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

CONCLUSION: No single indicator sufficiently describes replication success, and the five indicators examined here are not the only ways to evaluate reproducibility. Nonetheless, collectively these results offer a clear conclusion: A large portion of replications produced weaker evidence for the original findings despite using materials provided by the original authors, review in advance for methodological fidelity, and high statistical power to detect the original effect sizes. Moreover, correlational evidence is consistent with the conclusion that variation in the strength of initial evidence (such as original P value) was more predictive of replication success than variation in the characteristics of the teams conducting the research (such as experience and expertise)

Client Reviews

Many years after retiring from the USN, I suddenly found myself in a very unwelcome legal matter with the Navy. It was a total shock and I was very concerned as to the impact this would have on me and my...

Rob

I was facing accusations that would not only ruin my career but my life. When I hired Mr. Freeburg, he gave me the hope that everything would be turn out great. He put a great team together along with my...

Air Force Anonymous

Phil Cave has helped me through NJP and restoration of my security clearance. He even came to visit me in Spain. I never thought I would work again and he certainly through with advise and guidance that we're...

Bryan

Mr. Nathan Freeburg fought and won a war for me. A war where my life was on the line. The week of trial was extremely long but he never seemed like he was tired. The prosecution were getting whittled down each...

Navy Anonymous

Mr. Cave saved my military retirement! His promise to me from day one was that he would fight as hard as he could he right the wring that had been done to me. And he did! I am so very thankful and grateful to...

Crystal

Mr. Freeburg is passionate about justice and upholding the law and dignity of the court. He is brave and bold in his ability to represent his clients amidst the attempted intimidation and procedural pressure...

Navy Represented

The Army and prosecution was pushing for me to take a Chapter 10. But Mr. Freeburg made me confident we could win. We went to trial and he crushed them in cross examination and he saved my career.

Vince

Contact Us

  1. 1 Free Consultation
  2. 2 Over 40 Years of Experience
  3. 3 Dedicated to Military Law
Fill out the contact form or call us at 703-298-9562 to schedule your free consultation.

Leave Us a Message