Significance versus hypothesis testing
Datamethods Discussion Forum [Unofficial]
February 15, 2026
I think sample-size calculations are over-rated.
In response to my question, @s_doi and @f2harrell proposed alternate ways to estimate sample size. This is not the same as “abandoning” such calculations altogether, which would be ethically reckless, as explained at length by others elsewhere.
From the American Statistical Association’s Ethical Guidelines for Statistical Practice, Principle D, part 2:
The ethical statistical practitioner makes informed recommendations for sample size and statistical practice methodology to avoid the use of excessive or inadequate numbers of subjects and excessive risk to subjects.
(Part 3 is also relevant to those of us involved in animal studies, and make a related point about sample size.)
Discussion in the ATmosphere