Need help with statcheck?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

MicheleNuijten
137 Stars 26 Forks 509 Commits 12 Opened issues

!
?

# 478,135
R
141 commits
# 462,925
R
C
Shell
opensou...
42 commits
# 183,428
R
ggplot2
Jupyter...
TeX
6 commits
# 420,928
reprodu...
R
TeX
Electro...
6 commits
# 688,243
R
1 commit
# 517,468
R
forecas...
C
cross-v...
1 commit

# statcheck

## What is statcheck?

statcheck
is a free, open source R package that can be used to automatically extract statistical null-hypothesis significant testing (NHST) results from articles and recompute the p-values based on the reported test statistic and degrees of freedom to detect possible inconsistencies.

statcheck
is mainly useful for:
1. Self-checks: you can use
statcheck
to make sure your manuscript doesn’t contain copy-paste errors or other inconsistencies before you submit it to a journal.
2. Peer review: editors and reviewers can use
statcheck
to check submitted manuscripts for statistical inconsistencies. They can ask authors for a correction or clarification before publishing a manuscript.
3. Research:
statcheck
can be used to automatically extract statistical test results from articles that can then be analyzed. You can for instance investigate whether you can predict statistical inconsistencies (see e.g., Nuijten et al., 2017), or use it to analyze p-value distributions (see e.g., Hartgerink et al., 2016).

## How does statcheck work?

The algorithm behind

statcheck
consists of four basic steps:
1. Convert pdf and html articles to plain text files.
2. Search the text for instances of NHST results. Specifically,
statcheck
can recognize t-tests, F-tests, correlations, z-tests, (\chi^2) -tests, and Q-tests (from meta-analyses) if they are reported completely (test statistic, degrees of freedom, and p-value) and in APA style.
3. Recompute the p-value using the reported test statistic and degrees of freedom.
4. Compare the reported and recomputed p-value. If the reported p-value does not match the computed one, the result is marked as an inconsistency (
Error
in the output). If the reported p-value is significant and the computed is not, or vice versa, the result is marked as a gross inconsistency (
DecisionError
in the output).

statcheck
takes into account correct rounding of the test statistic, and has the option to take into account one-tailed testing. See the manual for details.

## Installation and use

For detailed information about installing and using

statcheck
, see the manual on RPubs.

statcheck.io is a web-based interface for statcheck.