Examining Selection Pressures in the Publication Process through the Lens of Sniff Tests

Christopher M. Snyder; Ran Zhuo

doi:10.1162/rest_a_01410

← Search

Examining Selection Pressures in the Publication Process through the Lens of Sniff Tests

Christopher M. Snyder¹; Ran Zhuo²

¹ Dartmouth College and NBER · ² University of Michigan

The Review of Economics and Statistics 2026

Economics papers increasingly report balance, pretrend, placebo, and other “sniff tests,” rejection of which is bad news for authors, undermining the credibility of their main results. We derive nonparametric bounds on the latent proportion of significant sniff tests removed by the publication process (whether by p-hacking or relegation to the file drawer) and the proportion whose significance was due to true misspecification, not bad luck. Using a hand-collected sample of nearly 30,000 sniff tests, we estimate a removal rate of more than 30% for balance tests in randomized controlled trials and a misspecification rate of more than 40% for other tests.

DOI: 10.1162/rest_a_01410
Volume: 108 (3)
Pages: 613-627
Language: en
Export: BibTeX
Sources: openalex crossref