Tags » Meta Science

New Preprint: Data Sharing & Statistical Inconsistencies

We just published the preprint of our new study “Journal Data Sharing Policies and Statistical Reporting Inconsistencies in Psychology” at https://osf.io/preprints/psyarxiv/sgbta.

In this paper, we ran three independent studies to investigate if data sharing is related to fewer statistical inconsistencies in a paper.  59 more words


Awarded a Campbell Methods Grant

I am honored to announce that Joshua R. Polanin and I were awarded a $20,000 methods grant from the Campbell Collaboration for the project “Verifying the Accuracy of Statistical Significance Testing in Campbell Collaboration Systematic Reviews Through the Use of the R Package statcheck”. 54 more words


Meta-Science 101 (Single Post)

(Comic taken from xkcd, here)

Part 1: An introduction

Science is in dire straits.

As you may know, a white man in a position of power has recently been criticizing science relentlessly, and it seems like that will continue to be the norm for at least the next four years.   10,815 more words


Meta-Science 101, Part 9: A conclusion

Let’s review.

Science in theory is pretty great, but in practice, science is done by people.  People have flaws, and these flaws infiltrate scientific practice.  Confirmation bias translates into researcher allegiance bias; you’re more likely to obtain a positive result if you believe in the hypothesis you’re testing.   1,109 more words


Meta-Science 101, Part 8: Snakes at the top

Now that we’re at the top of the epistemic pyramid, let’s see what diamonds we can find up here.  Here’s one systematic review that says… 1,451 more words


Meta-Science 101, Part 7: The replication crisis

“Your work never gets replicated, but if it was, the replication might not have confirmed your finding.”

In the last section, I ended off with a graph showing that higher-impact-factor journals have more retractions.   1,404 more words


Meta-Science 101, Part 6: Publication bias

“Meanwhile, alternate-universe-you that didn’t find a statistically significant result doesn’t publish. The results sit in a file drawer.”

If you’re suffering from depression, have you asked your doctor about reboxetine? 920 more words