Justify your alpha

Daniel Lakens,Federico G. Adolfi,Casper J. Albers,Farid Anvari,Matthew A. J. Apps,Shlomo Argamon,Thom Baguley,Raymond Becker,Stephen D. Benning,Daniel E. Bradford,Erin M. Buchanan,Aaron R. Caldwell,Ben Van Calster,Rickard Carlsson,Sau Chin Chen,Bryan Ping Ho Chung,Lincoln John Colling,Gary S. Collins,Zander Crook,Emily S. Cross,Sameera Daniels,Henrik Danielsson,Lisa M. DeBruine,Daniel J. Dunleavy,Brian D. Earp,Michele I. Feist,Jason D. Ferrell,James G. Field,Nicholas W. Fox,Amanda Friesen,Caio Gomes,Monica Gonzalez-Marquez,James A. Grange,Andrew P. Grieve,Robert Guggenberger,James Grist,Anne-Laura van Harmelen,Fred Hasselman,Kevin D. Hochard,Mark R. Hoffarth,Nicholas P. Holmes,Michael Ingre,Peder M. Isager,Hanna K. Isotalus,Christer Johansson,Konrad Juszczyk,David A. Kenny,Ahmed A. Khalil,Barbara Konat,Junpeng Lao,Erik Gahner Larsen,Gerine M. A. Lodder,Jiří Lukavsky,Christopher R. Madan,David Manheim,Stephen R. Martin,Andrea E. Martin,Deborah G. Mayo,Randy J. McCarthy,Kevin McConway,Colin McFarland,Amanda Q. X. Nio,Gustav Nilsonne,Cilene Lino-de-Oliveira,Jean-Jacques Orban de Xivry,Sam Parsons,Gerit Pfuhl,Kimberly A. Quinn,John J. Sakon,S. Adil Saribay,Iris K. Schneider,Manojkumar Selvaraju,Zsuzsika Sjoerds,Samuel G. Smith,Tim Smits,Jeffrey R. Spies,Vishnu Sreekumar,Crystal N. Steltenpohl,Neil Stenhouse,Wojciech Swiatkowski,Miguel A. Vadillo,Marcel A.L.M. van Assen,Matt N. Williams,Samantha E. Williams,Donald R. Williams,Tal Yarkoni,Ignazio Ziano,Rolf A. Zwaan

Justify your alpha

2018

Daniel Lakens
Federico G. Adolfi
Casper J. Albers
Farid Anvari
Matthew A. J. Apps
Shlomo Argamon
Thom Baguley
Raymond Becker
Stephen D. Benning
Daniel E. Bradford
Erin M. Buchanan
Aaron R. Caldwell
Ben Van Calster
Rickard Carlsson
Sau Chin Chen
Bryan Ping Ho Chung
Lincoln John Colling
Gary S. Collins
Zander Crook
Emily S. Cross
Sameera Daniels
Henrik Danielsson
Lisa M. DeBruine
Daniel J. Dunleavy
Brian D. Earp
Michele I. Feist
Jason D. Ferrell
James G. Field
Nicholas W. Fox
Amanda Friesen
Caio Gomes
Monica Gonzalez-Marquez
James A. Grange
Andrew P. Grieve
Robert Guggenberger
James Grist
Anne-Laura van Harmelen
Fred Hasselman
Kevin D. Hochard
Mark R. Hoffarth
Nicholas P. Holmes
Michael Ingre
Peder M. Isager
Hanna K. Isotalus
Christer Johansson
Konrad Juszczyk
David A. Kenny
Ahmed A. Khalil
Barbara Konat
Junpeng Lao
Erik Gahner Larsen
Gerine M. A. Lodder
Jiří Lukavsky
Christopher R. Madan
David Manheim
Stephen R. Martin
Andrea E. Martin
Deborah G. Mayo
Randy J. McCarthy
Kevin McConway
Colin McFarland
Amanda Q. X. Nio
Gustav Nilsonne
Cilene Lino-de-Oliveira
Jean-Jacques Orban de Xivry
Sam Parsons
Gerit Pfuhl
Kimberly A. Quinn
John J. Sakon
S. Adil Saribay
Iris K. Schneider
Manojkumar Selvaraju
Zsuzsika Sjoerds
Samuel G. Smith
Tim Smits
Jeffrey R. Spies
Vishnu Sreekumar
Crystal N. Steltenpohl
Neil Stenhouse
Wojciech Swiatkowski
Miguel A. Vadillo
Marcel A.L.M. van Assen
Matt N. Williams
Samantha E. Williams
Donald R. Williams
Tal Yarkoni
Ignazio Ziano
Rolf A. Zwaan

In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.

Keywords:

p-value
Statistics
Alpha (ethology)
Mathematics
Statistical significance
Peer review
Psychology
alpha level

Correction
Source
Cite
Save
Machine Reading By IdeaReader

References

206

Citations