C Example of statcheck report for PubPeer

The HTML version of this article was scanned on 5 August 2016 for statistical results (\(t\), \(r\), \(F\), \(\chi^2\), and \(Z\) values) reported in APA format (for specifics, see Nuijten, Hartgerink, et al. 2015). An automatically generated report follows.

The scan detected 5 statistical results in APA format, of which 3 contained potentially incorrect statistical results, of which 1 may change statistical significance (\(\alpha\)=0.05). Potential one-tailed results were taken into account when “one-sided”, “one-tailed”, or “directional” occurred in the text. The errors that may change statistical significance were reported as:

\(t(67)=-0.436, p<0.001\) (recalculated \(p\)-value: 0.66424)

The errors that may affect the computed \(p\)-value (but not the statistical significance) were reported as:

\(F(1,126)=2.1, p>0.90\) (recalculated \(p\)-value: 0.14978)

\(t(67)=-1.02, p=0.35\) (recalculated \(p\)-value: 0.31140)

Note that these are not definitive results and require manual inspection to definitively assess whether results are erroneous.

Aberson, Christopher L. 2010. “What is power? Why is power important?” In Applied power analysis for the behavioral sciences, edited by Christopher L Aberson. New York, NY: Routledge.

Aczel, Balazs, Bence Palfi, and Barnabas Szaszi. 2017. “Estimating the Evidential Value of Significant Results in Psychological Science.” Edited by Jelte M. Wicherts. PLOS ONE 12 (8). Public Library of Science (PLoS): e0182651. doi:10.1371/journal.pone.0182651.

Agresti, Alan. 2003. Categorical Data Analysis. Vol. 482. London, United Kingdom: John Wiley & Sons. https://mathdept.iut.ac.ir/sites/mathdept.iut.ac.ir/files/AGRESTI.PDF.

Akhtar-Danesh, Noori, and Mahshid Dehghan-Kooshkghazi. 2003. “How Does Correlation Structure Differ Between Real and Fabricated Data-Sets?” BMC Medical Research Methodology 3 (1). Springer Nature. doi:10.1186/1471-2288-3-18.

Allen, Mary, and Robin Dowell. 2013. “Retrospective Reflections of a Whistleblower: Opinions on Misconduct Responses.” Accountability in Research 20 (5-6): 339–48. doi:10.1080/08989621.2013.822249.

American Psychological Association. 1983. Publication manual of the American Psychological Association. 3rd ed. Washington, DC: American Psychological Association.

———. 2001. Publication manual of the American Psychological Association. 5th ed. Washington, DC: American Psychological Association.

———. 2010a. “Ethical Principles of Psychologists and Code of Conduct.” http://www.apa.org/ethics/code/principles.pdf. http://www.apa.org/ethics/code/principles.pdf.

———. 2010b. Publication Manual of the American Psychological Association. 6th ed. Washington, DC: American Psychological Association.

Anaya, Jordan. 2016. “The Grimmer Test: A Method for Testing the Validity of Reported Measures of Variability.” PeerJ Preprints 4 (August): e2400v1. doi:10.7287/peerj.preprints.2400v1.

Anderson, C. J., t pan Bahnik, M. Barnett-Cowan, F. A. Bosco, J. Chandler, C. R. Chartier, F. Cheung, et al. 2016. “Response to Comment on ‘Estimating the Reproducibility of Psychological Science’.” Science 351 (6277). American Association for the Advancement of Science (AAAS): 1037–7. doi:10.1126/science.aad9163.

Anderson, Melissa S, Aaron S Horn, Kelly R Risbey, Emily A Ronning, Raymond De Vries, and Brian C Martinson. 2007. “What Do Mentoring and Training in the Responsible Conduct of Research Have to Do with Scientists’ Misbehavior? Findings from a National Survey of NIH-funded Scientists.” Academic Medicine 82 (9): 853. doi:10.1097/ACM.0b013e31812f764c.

Anderson, Melissa S, Brian C Martinson, and Raymond De Vries. 2007. “Normative Dissonance in Science: Results from a National Survey of U.s. Scientists.” Journal of Empirical Research on Human Research Ethics 2 (4): 3–14. doi:10.1525/jer.2007.2.4.3.

Anderson, Melissa S, Emily A Ronning, Raymond Devries, and Brian C Martinson. 2010. “Extending the Mertonian Norms: Scientists’ Subscription to Norms of Research.” The Journal of Higher Education 81 (3): 366–93. doi:10.1353/jhe.0.0095.

Anonymous. 2012. “Suspicion of scientific misconduct by Dr. Jens Foerster.” http://wayback.archive.org/web/20170511084213/https://retractionwatch.files.wordpress.com/2014/04/report_foerster.pdf.

Armitage, P., C. K. McPherson, and B. C. Rowe. 1969. “Repeated Significance Tests on Accumulating Data.” Journal of the Royal Statistical Society. Series A (General) 132 (2). JSTOR: 235. doi:10.2307/2343787.

Asendorpf, Jens B., Mark Conner, Filip De Fruyt, Jan De Houwer, Jaap J. A. Denissen, Klaus Fiedler, Susann Fiedler, et al. 2013. “Recommendations for Increasing Replicability in Psychology.” European Journal of Personality 27 (2). Wiley: 108–19. doi:10.1002/per.1919.

Bailey, Kent R. 1991. “Detecting Fabrication of Data in a Multicenter Collaborative Animal Study.” Controlled Clinical Trials 12 (6). Elsevier BV: 741–52. doi:10.1016/0197-2456(91)90037-m.

Bakan, David. 1966. “The Test of Significance in Psychological Research.” Psychological Bulletin 66 (6). American Psychological Association (APA): 423–37. doi:10.1037/h0020412.

Baker, Monya. 2016. “1,500 Scientists Lift the Lid on Reproducibility.” Nature 533 (7604). Springer Nature: 452–54. doi:10.1038/533452a.

Bakker, Marjan, and Jelte M Wicherts. 2011. “The (Mis)reporting of Statistical Results in Psychology Journals.” Behavior Research Methods 43 (3): 666–78. doi:10.3758/s13428-011-0089-5.

Bakker, Marjan, and Jelte M. Wicherts. 2014. “Outlier Removal, Sum Scores, and the Inflation of the Type I Error Rate in Independent Samples T Tests: The Power of Alternatives and Recommendations.” Psychological Methods 19 (3). American Psychological Association (APA): 409–27. doi:10.1037/met0000014.

Bakker, Marjan, Annette van Dijk, and Jelte M Wicherts. 2012. “The rules of the game called psychological science.” Perspectives on Psychological Science 7 (6): 543–54. doi:10.1177/1745691612459060.

Bakker, Marjan, Chris H. J. Hartgerink, Jelte M. Wicherts, and Han L. J. van der Maas. 2016. “Researchers’ Intuitions About Power in Psychological Research.” Psychological Science 27 (8). SAGE Publications: 1069–77. doi:10.1177/0956797616647519.

Baldwin, Melinda. 2015. Making Nature: The History of a Scientific Journal. University of Chicago Press.

Baldwin, Peter. 2014. The Copyright Wars: Three Centuries of Trans-Atlantic Battle. Princeton University Press.

Bauer, Johannes, and Jochen Gross. 2011. “Difficulties Detecting Fraud? The Use of Benford’s Law on Regression Tables.” Edited by AndreasEditor Diekmann. Methodological Artefacts, Data Manipulation and Fraud in Economics and Social Science, January. De Gruyter. doi:10.1515/9783110508420-010.

Begley, C. Glenn, and Lee M. Ellis. 2012. “Raise Standards for Preclinical Cancer Research.” Nature 483 (7391). Springer Nature: 531–33. doi:10.1038/483531a.

Bem, Daryl J. 2000. “Writing an Empirical Article.” Edited by Robert J. Sternberg. Cambridge University Press, 3–16. doi:10.1017/cbo9780511807862.002.

Benford, Frank. 1938. “The Law of Anomalous Numbers.” Proceedings of the American Philosophical Society 78 (4). American Philosophical Society: 551–72. http://www.jstor.org/stable/984802.

Benjamini, Y., and Y. Hechtlinger. 2013. “Discussion: An Estimate of the Science-Wise False Discovery Rate and Applications to Top Medical Journals by Jager and Leek.” Biostatistics 15 (1). Oxford University Press (OUP): 13–16. doi:10.1093/biostatistics/kxt032.

Berg, Jeremy. 2017. “Preprint Ecosystems.” Science 357 (6358). American Association for the Advancement of Science (AAAS): 1331–1. doi:10.1126/science.aaq0167.

Berger, Arno, and Theodore P. Hill. 2011. “A Basic Theory of Benford’s Law.” Probability Surveys 8 (0). Institute of Mathematical Statistics: 1–126. doi:10.1214/11-ps175.

Bik, Elisabeth M., Arturo Casadevall, and Ferric C. Fang. 2016a. “The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications.” mBio 7 (3). American Society for Microbiology: e00809–16. doi:10.1128/mbio.00809-16.

———. 2016b. “The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications.” mBio 7 (3). American Society for Microbiology: e00809–16. doi:10.1128/mbio.00809-16.

Bishop, Dorothy V, and Paul A Thompson. 2015. “Problems in Using Text-Mining and P-Curve Analysis to Detect Rate of P-Hacking.” PeerJ PrePrints 3 (July): e1550. doi:10.7287/peerj.preprints.1266v1.

Bishop, Dorothy V.M., and Paul A. Thompson. 2016. “Problems in Usingp-Curve Analysis and Text-Mining to Detect Rate Ofp-Hacking and Evidential Value.” PeerJ 4 (February). PeerJ: e1715. doi:10.7717/peerj.1715.

Bloudoff-Indelicato, Mollie. 2015. “Text-Mining Block Prompts Online Response.” Nature 527 (7579). Springer Nature: 413–13. doi:10.1038/527413f.

Bohannon, John. 2016a. “Who’s Downloading Pirated Papers? Everyone.” Science. doi:10.1126/science.aaf5664.

———. 2016b. “Who’s Downloading Pirated Papers? Everyone.” Science 352 (6285). American Association for the Advancement of Science (AAAS): 508–12. doi:10.1126/science.352.6285.508.

Bolland, Mark J., Greg D. Gamble, Alison Avenell, and Andrew Grey. 2019. “Rounding, but Not Randomization Method, Non-Normality, or Correlation, Affected Baseline P-Value Distributions in Randomized Trials.” Journal of Clinical Epidemiology 110 (June). Elsevier BV: 50–62. doi:10.1016/j.jclinepi.2019.03.001.

Borenstein, Michael, Larry V. Hedges, Julian P. T. Higgins, and Hannah R. Rothstein. 2011. Introduction to Meta-Analysis. Wiley.

Bornemann-Cimenti, Helmar, Istvan S Szilagyi, and Andreas Sandner-Kiesling. 2015. “Perpetuation of Retracted Publications Using the Example of the Scott S. Reuben Case: Incidences, Reasons and Possible Improvements.” Science and Engineering Ethics, 7~jul. doi:10.1007/s11948-015-9680-y.

Bornmann, Lutz, Irina Nast, and Hans-Dieter Daniel. 2008. “Do Editors and Referees Look for Signs of Scientific Misconduct When Reviewing Manuscripts? A Quantitative Content Analysis of Studies That Examined Review Criteria and Reasons for Accepting and Rejecting Manuscripts for Publication.” Scientometrics 77 (3). Springer Netherlands: 415–32. doi:10.1007/s11192-007-1950-2.

Bradley, Jean-Claude. 2007. “Open Notebook Science Using Blogs and Wikis.” Nature Precedings, June. Springer Nature. doi:10.1038/npre.2007.39.1.

Brembs, Björn. 2018. “Prestigious Science Journals Struggle to Reach Even Average Reliability.” Frontiers in Human Neuroscience 12 (February). Frontiers Media SA. doi:10.3389/fnhum.2018.00037.

Bridle, James. 2018. New Dark Age: Technology and the End of the Future. Verso.

Broad, William, and Nicholas Wade. 1983. Betrayers of the Truth. New York, NY: Simon; Schuster.

Broockman, David, Joshua Kalla, and Peter Aronow. 2015. “Irregularities in LaCour (2014).” https://wayback.archive.org/web/20180823093137/http://stanford.edu/~dbroock/broockman_kalla_aronow_lg_irregularities.pdf.

Brown, Nicholas J. L., and James A. J. Heathers. 2016. “The GRIM Test.” Social Psychological and Personality Science 8 (4). SAGE Publications: 363–69. doi:10.1177/1948550616673876.

Bruns, Stephan B., and John P. A. Ioannidis. 2016. “P-Curve and P-Hacking in Observational Research.” PLOS ONE 11 (2). Public Library of Science: 1–13. doi:10.1371/journal.pone.0149144.

Burns, Bruce D. 2009. “Sensitivity to statistical regularities : People (largely) follow Benford’s law.” In Proceedings of the Thirty First Annual Conference of the Cognitive Science Society. Austin, TX: Cognitive Science Society. http://wayback.archive.org/web/20170619175106/http://csjarchive.cogsci.rpi.edu/Proceedings/2009/papers/637/paper637.pdf.

Buyse, M, S L George, S Evans, N L Geller, J Ranstam, B Scherrer, E Lesaffre, et al. 1999. “The Role of Biostatistics in the Prevention, Detection and Treatment of Fraud in Clinical Trials.” Statistics in Medicine 18 (24): 3435–51. doi:10.1002/(SICI)1097-0258(19991230)18:24<3435::AID-SIM365>3.0.CO;2-O.

Camerer, C. F., A. Dreber, E. Forsell, T.-H. Ho, J. Huber, M. Johannesson, M. Kirchler, et al. 2016. “Evaluating Replicability of Laboratory Experiments in Economics.” Science 351 (6280). American Association for the Advancement of Science (AAAS): 1433–6. doi:10.1126/science.aaf0918.

Capadisli, Sarven, Amy Guy, Ruben Verborgh, Christoph Lange, Soeren Auer, and Tim Berners-Lee. 2017. “Decentralised Authoring, Annotations and Notifications for a Read-Write Web with Dokieli.” https://wayback.archive.org/web/20180807191810/http://csarven.ca/dokieli-rww.

Carlisle, J. B. 2012. “The Analysis of 168 Randomised Controlled Trials to Test Data Integrity.” Anaesthesia 67 (5): 521–37. doi:10.1111/j.1365-2044.2012.07128.x.

———. 2017a. “Data Fabrication and Other Reasons for Non-Random Sampling in 5087 Randomised, Controlled Trials in Anaesthetic and General Medical Journals.” Anaesthesia, June. Wiley-Blackwell. doi:10.1111/anae.13938.

———. 2017b. “Seeking and Reporting Apparent Research Misconduct: Errors and Integrity - a Reply.” Anaesthesia 73 (1). Wiley: 126–28. doi:10.1111/anae.14148.

Carlisle, J. B., and J. A. Loadsman. 2016. “Evidence for Non-Random Sampling in Randomised, Controlled Trials by Yuhji Saitoh.” Anaesthesia 72 (1). Wiley: 17–27. doi:10.1111/anae.13650.

Carlisle, J. B., F. Dexter, J. J. Pandit, S. L. Shafer, and S. M. Yentis. 2015. “Calculating the Probability of Random Sampling for Continuous Variables in Submitted or Published Randomised Controlled Trials.” Anaesthesia 70 (7): 848–58. doi:10.1111/anae.13126.

Casella, George, and Roger L. Berger. 2001. Statistical Inference. Cengage Learning.

Cavdar, Derya, and Fatih Alagoz. 2012. “A Survey of Research on Greening Data Centers.” 2012 IEEE Global Communications Conference (GLOBECOM), December. IEEE. doi:10.1109/glocom.2012.6503613.

Chamberlain, Scott, Carl Boettiger, and Karthik Ram. 2015. “Rplos: Interface to the Search ’API’ for ’PLoS’ Journals.” http://CRAN.R-project.org/package=rplos.

Chambers, Christopher D. 2015. “Ten Reasons Why Journals Must Review Manuscripts Before Results Are Known.” Addiction 110 (1): 10–11. doi:10.1111/add.12728.

Chambers, Christopher D. 2013. “Registered Reports: A New Publishing Initiative at Cortex.” Cortex 49 (3). Elsevier BV: 609–10. doi:10.1016/j.cortex.2012.12.016.

Cheung, I., L. Campbell, E. P. LeBel, R. A. Ackerman, B. Aykutoğlu, Š. Bahník, J. D. Bowen, et al. 2016. “Registered Replication Report.” Perspectives on Psychological Science 11 (5). SAGE Publications: 750–64. doi:10.1177/1745691616664694.

Cho, Wendy K. Tam, and Brian J. Gaines. 2007. “Breaking the (Benford) Law: Statistical Fraud Detection in Campaign Finance.” The American Statistician 61 (3). [American Statistical Association, Taylor & Francis, Ltd.]: 218–23. http://www.jstor.org/stable/27643897.

Cialdini, Robert B., and Noah J. Goldstein. 2004. “Social Influence: Compliance and Conformity.” Annual Review of Psychology 55 (1). Annual Reviews: 591–621. doi:10.1146/annurev.psych.55.090902.142015.

Clark, Tim, Paolo N Ciccarese, and Carole A Goble. 2014. “Micropublications: A Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communications.” Journal of Biomedical Semantics 5 (1). Springer Nature: 28. doi:10.1186/2041-1480-5-28.

Cohen, Jacob. 1962. “The Statistical Power of Abnormal-Social Psychological Research: A Review.” The Journal of Abnormal and Social Psychology 65 (3). American Psychological Association (APA): 145–53. doi:10.1037/h0045186.

———. 1988. Statistical Power Analysis for the Behavioral Sciences (2nd Edition). Routledge.

———. 1994. “The Earth Is Round (P < .05).” American Psychologist 49 (12): 997–1003. doi:10.1037/0003-066X.49.12.997.

Cressey, Daniel. 2013. “’Rehab’ Helps Errant Researchers Return to the Lab.” Nature News 493 (7431): 147. doi:10.1038/493147a.

Cumming, Geoff. 2013. “The New Statistics.” Psychological Science 25 (1). SAGE Publications: 7–29. doi:10.1177/0956797613504966.

Cyranoski, David. 2015. “Collateral Damage: How One Misconduct Case Brought a Biology Institute to Its Knees.” Nature 520 (7549). Springer Nature: 600–603. doi:10.1038/520600a.

De Groot, A.D. 1994. Methodologie: Grondslagen van Onderzoek En Denken in de Gedragswetenschappen [Methodology: Foundations of Research and Thinking in the Behavioral Sciences]. Assen, the Netherlands: Van Gorcum.

De Winter, Joost CF, and Dimitra Dodou. 2015. “A Surge of P-Values Between 0.041 and 0.049 in Recent Decades (but Negative Results Are Increasing Rapidly Too).” PeerJ 3 (January). PeerJ: e733. doi:10.7717/peerj.733.

Diekmann, Andreas. 2007. “Not the First Digit! Using Benford’s Law to Detect Fraudulent Scientific Data.” Journal of Applied Statistics 34 (3). Taylor & Francis: 321–29. doi:10.1080/02664760601004940.

Domenico, Manlio De, and Alex Arenas. 2017. “Modeling Structure and Resilience of the Dark Network.” Physical Review E 95 (2). American Physical Society (APS). doi:10.1103/physreve.95.022313.

Durtschi, Cindy, William Hillison, and Carl Pacini. 2004. “The Effective Use of Benford’s Law to Assist in Detecting Fraud in Accounting Data.” Journal of Forensic Accounting 5 (1): 17–34.

Easterbrook, P.J, R Gopalan, J.A Berlin, and D.R Matthews. 1991. “Publication Bias in Clinical Research.” The Lancet 337 (8746). Elsevier BV: 867–72. doi:10.1016/0140-6736(91)90201-y.

Ebersole, Charles R., Olivia E. Atherton, Aimee L. Belanger, Hayley M. Skulborstad, Jill M. Allen, Jonathan B. Banks, Erica Baranski, et al. 2016. “Many Labs 3: Evaluating Participant Pool Quality Across the Academic Semester via Replication.” Journal of Experimental Social Psychology 67 (November). Elsevier BV: 68–82. doi:10.1016/j.jesp.2015.10.012.

Elia, Nadia, Elizabeth Wager, and Martin R. Tramèr. 2014. “Fate of Articles That Warranted Retraction Due to Ethical Concerns: A Descriptive Cross-Sectional Study.” Edited by K. BradEditor Wray. PLoS ONE 9 (1). Public Library of Science (PLoS): e85846. doi:10.1371/journal.pone.0085846.

Ellemers, Naomi. 2017. “Ethisch klimaat op het werk: Op zoek naar het nieuwe normaal [Ethical climate at work: Searching for the new normal].” https://wayback.archive.org/web/20180726070256/https://www.scoop-program.org/images/Tekst_Oratie_Naomi_Ellemers_9_februari_2017.pdf.

Epskamp, Sacha, and Michèle B. Nuijten. 2016. Statcheck: Extract Statistics from Articles and Recompute P Values. https://CRAN.R-project.org/package=statcheck.

Etz, Alexander, and Joachim Vandekerckhove. 2016. “A Bayesian Perspective on the Reproducibility Project: Psychology.” Edited by DanieleEditor Marinazzo. PLOS ONE 11 (2). Public Library of Science (PLoS): e0149794. doi:10.1371/journal.pone.0149794.

Fanelli, Daniele. 2009. “How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data.” PloS ONE 4 (5): e5738. doi:10.1371/journal.pone.0005738.

———. 2011. “Negative Results Are Disappearing from Most Disciplines and Countries.” Scientometrics 90 (3). Springer Nature: 891–904. doi:10.1007/s11192-011-0494-7.

Fanelli, Daniele, Rodrigo Costas, Ferric C. Fang, Arturo Casadevall, and Elisabeth M. Bik. 2018. “Testing Hypotheses on Risk Factors for Scientific Misconduct via Matched-Control Analysis of Papers Containing Problematic Image Duplications.” Science and Engineering Ethics, February. Springer Nature. doi:10.1007/s11948-018-0023-7.

Fang, Ferric C, R Grant Steen, and Arturo Casadevall. 2012. “Misconduct Accounts for the Majority of Retracted Scientific Publications.” Proceedings of the National Academy of Sciences of the United States of America 109 (42): 17028–33. doi:10.1073/pnas.1212247109.

Fareed, Mohd, Malik Azeem Anwar, and Mohammad Afzal. 2015. “Prevalence and Gene Frequency of Color Vision Impairments Among Children of Six Populations from North Indian Region.” Genes & Diseases 2 (2). Elsevier BV: 211–18. doi:10.1016/j.gendis.2015.02.006.

Ferguson, Christopher J. 2015. “‘Everybody Knows Psychology Is Not a Real Science’: Public Perceptions of Psychology and How We Can Improve Our Relationship with Policymakers, the Scientific Community, and the General Public.” American Psychologist 70 (6). American Psychological Association (APA): 527–42. doi:10.1037/a0039405.

Fewster, R. M. 2009. “A Simple Explanation of Benford’s Law.” The American Statistician 63 (1): 26–32. doi:10.1198/tast.2009.0005.

Fiedler, Klaus, Florian Kutzner, and Joachim I. Krueger. 2012. “The Long Way from Alpha-Error Control to Validity Proper.” Perspectives on Psychological Science 7 (6). SAGE Publications: 661–69. doi:10.1177/1745691612462587.

Fisher, Ronald Aylmer. 1925. Statistical methods for research workers. Edinburg, United Kingdom: Oliver Boyd.

Fleck, Ludwig. 1984. Genesis and Development of a Scientific Fact. Chicago, IL: University of Chicago Press.

Fortunato, Santo, Carl T. Bergstrom, Katy Börner, James A. Evans, Dirk Helbing, Staša Milojević, Alexander M. Petersen, et al. 2018. “Science of Science.” Science 359 (6379). American Association for the Advancement of Science (AAAS): eaao0185. doi:10.1126/science.aao0185.

Fraley, R. Chris, and Simine Vazire. 2014. “The N-Pact Factor: Evaluating the Quality of Empirical Journals with Respect to Sample Size and Statistical Power.” Edited by Christos A.Editor Ouzounis. PLoS ONE 9 (10). Public Library of Science (PLoS): e109019. doi:10.1371/journal.pone.0109019.

Francis, Gregory. 2012. “Too Good to Be True: Publication Bias in Two Prominent Studies from Experimental Psychology.” Psychonomic Bulletin & Review 19 (2). Springer Nature: 151–56. doi:10.3758/s13423-012-0227-9.

Franco, Annie, Neil Malhotra, and Gabor Simonovits. 2014. “Publication Bias in the Social Sciences: Unlocking the File Drawer.” Science 345 (6203): 1502–5. doi:10.1126/science.1255484.

———. 2016. “Underreporting in Psychology Experiments: Evidence from a Study Registry.” Social Psychological and Personality Science 7 (1): 8–12. doi:10.1177/1948550615598377.

García-Berthou, Emili, and Carles Alcaraz. 2004. “Incongruence Between Test Statistics and P Values in Medical Papers.” BMC Medical Research Methodology 4 (1). Springer Nature. doi:10.1186/1471-2288-4-13.

Garfield, Eugene. 2006. “The History and Meaning of the Journal Impact Factor.” JAMA 295 (1). American Medical Association (AMA): 90. doi:10.1001/jama.295.1.90.

Gelman, A., and K. O’Rourke. 2013. “Discussion: Difficulties in Making Inferences About Scientific Truth from Distributions of Published P-Values.” Biostatistics 15 (1). Oxford University Press (OUP): 18–23. doi:10.1093/biostatistics/kxt034.

Gelman, Andrew, and Eric Loken. 2013. “The Garden of Forking Paths: Why Multiple Comparisons Can Be a Problem, Even When There Is No ‘Fishing Expedition’ or ‘P-Hacking’ and the Research Hypothesis Was Posited Ahead of Time.” https://wayback.archive.org/web/20180712075516/http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf.

Gerber, Alan S., Neil Malhotra, Conor M. Dowling, and David Doherty. 2010. “Publication Bias in Two Political Behavior Literatures.” American Politics Research 38 (4). SAGE Publications: 591–613. doi:10.1177/1532673x09350979.

Gignac, Gilles E., and Eva T. Szodorai. 2016. “Effect Size Guidelines for Individual Differences Researchers.” Personality and Individual Differences 102 (November). Elsevier BV: 74–78. doi:10.1016/j.paid.2016.06.069.

Gilbert, D. T., G. King, S. Pettigrew, and T. D. Wilson. 2016. “Comment on ‘Estimating the Reproducibility of Psychological Science’.” Science 351 (6277). American Association for the Advancement of Science (AAAS): 1037–7. doi:10.1126/science.aad7243.

Giner-Sorolla, Roger. 2012. “Science or Art? How Aesthetic Standards Grease the Way Through the Publication Bottleneck but Undermine Science.” Perspectives on Psychological Science 7 (6). SAGE Publications: 562–71. doi:10.1177/1745691612457576.

Ginsel, Bastiaan, Abhinav Aggarwal, Wei Xuan, and Ian Harris. 2015. “The Distribution of Probability Values in Medical Abstracts: An Observational Study.” BMC Research Notes 8 (1). Springer Nature. doi:10.1186/s13104-015-1691-x.

Goodman, S. N. 2013. “Discussion: An Estimate of the Science-Wise False Discovery Rate and Application to the Top Medical Literature.” Biostatistics 15 (1). Oxford University Press (OUP): 23–27. doi:10.1093/biostatistics/kxt035.

Goodman, Steven. 2008. “A Dirty Dozen: Twelve P-Value Misconceptions.” Seminars in Hematology 45 (3). Elsevier BV: 135–40. doi:10.1053/j.seminhematol.2008.04.003.

Greenwald, Anthony G. 1975. “Consequences of Prejudice Against the Null Hypothesis.” Psychological Bulletin 82 (1). American Psychological Association (APA): 1–20. doi:10.1037/h0076157.

Grossmann, Alexander, and Björn Brembs. 2019. “Assessing the Size of the Affordability Problem in Scholarly Publishing,” June. PeerJ. doi:10.7287/peerj.preprints.27809v1.

Groth, Paul, Andrew Gibson, and Jan Velterop. 2010. “The Anatomy of a Nanopublication.” Information Services & Use 30 (1-2). IOS Press: 51–56. doi:10.3233/isu-2010-0613.

Haldane, J B S. 1948. “The faking of genetical results.” Eureka 6: 21–28. http://wayback.archive.org/web/20170206144438/http://www.archim.org.uk/eureka/27/faking.html.

Hanley, J A, and B J McNeil. 1982. “The Meaning and Use of the Area Under a Receiver Operating Characteristic (ROC) Curve.” Radiology 143 (1). Radiological Society of North America (RSNA): 29–36. doi:10.1148/radiology.143.1.7063747.

Harnad, Stevan. 2000. “The Invisible Hand of Peer Review.” Exploit Interactive. http://cogprints.org/1646/.

Hartgerink, Chris H. J. 2014. “Poster: Low Threshold Open Science.” figshare. doi:10.6084/m9.figshare.928315.v2.

———. 2015a. “Do Not Trust Science Verify It.” Authorea, Inc. doi:10.15200/winn.144232.26366.

———. 2015b. “Elsevier Stopped Me Doing My Research.” https://wayback.archive.org/web/20180814123817/http://onsnetwork.org/chartgerink/2015/11/16/elsevier-stopped-me-doing-my-research/.

———. 2016a. “Wiley Also Stopped Me Doing My Research.” https://wayback.archive.org/web/20180814123807/http://onsnetwork.org/chartgerink/2016/02/23/wiley-also-stopped-my-doing-my-research/.

———. 2016b. “688,112 Statistical Results: Content Mining Psychology Articles for Statistical Test Results.” Data 1 (3). MDPI AG: 14. doi:10.3390/data1030014.

———. 2017a. “Developing the Potential of Data Extraction in Scholarly Articles for Research Verification.” D-Lib Magazine. http://www.dlib.org/dlib/may17/05inbrief.html#HARTGERINK.

———. 2017b. “Reanalyzing Head et Al. (2015): Investigating the Robustness of Widespread P-Hacking.” PeerJ 5 (March). PeerJ: e3068. doi:10.7717/peerj.3068.

———. 2018. “Publishers Need to Stop Using Insecure Http.” https://wayback.archive.org/web/20180807191523/https://opensource.com/article/18/5/scholarly-publishers-https.

Hartgerink, Chris H. J., and Marino van Zelst. 2018. “As-You-Go Instead of After-the-Fact: A Network Approach to Scholarly Communication and Evaluation.” Publications 6 (2). MDPI AG: 21. doi:10.3390/publications6020021.

Hartgerink, Chris H. J., Robbie C. M. Van Aert, Michèle B. Nuijten, Jelte M. Wicherts, and Marcel A.L.M. Van Assen. 2016. “Distributions Ofp-Values Smaller Than .05 in Psychology: What Is Going on?” PeerJ 4 (April). PeerJ: e1935. doi:10.7717/peerj.1935.

Hartgerink, Chris H. J., Jan V Voelkel, Jelte M Wicherts, and Marcel ALM van Assen. 2017. “Transcripts of 28 interviews with researchers who fabricated data for an experiment.” doi:10.5281/zenodo.832490.

Hartgerink, Chris H. J., J. M. Wicherts, and M. A. L. M. Van Assen. 2017. “Too Good to Be False: Nonsignificant Results Revisited.” Collabra: Psychology 3 (1). University of California Press: 9. doi:10.1525/collabra.71.

Hartgerink, Chris H. J., Jelte Wicherts, and Marcel van Assen. 2016. “The Value of Statistical Tools to Detect Data Fabrication.” Research Ideas and Outcomes 2 (April). Pensoft Publishers: e8860. doi:10.3897/rio.2.e8860.

Head, Megan, Luke Holman, Rob Lanfear, Andrew Kahn, and Michael Jennions. 2015a. “Data from: The extent and consequences of p-hacking in science.” Dryad Digital Repository. doi:10.5061/dryad.79d43.

———. 2015b. “The extent and consequences of p-hacking in science.” PLOS Biology 13: e1002106. doi:10.1371/journal.pbio.1002106.

Heathers, James A, Jordan Anaya, Tim van der Zee, and Nicholas JL Brown. 2018. “Recovering Data from Summary Statistics: Sample Parameter Reconstruction via Iterative TEchniques (SPRITE),” May. PeerJ. doi:10.7287/peerj.preprints.26968v1.

Hedges, L V, and I Olkin. 1985. Statistical methods for meta-analysis. London, United Kingdom: Academic Press.

Hedges, Larry V. 1981. “Distribution Theory for Glass’s Estimator of Effect Size and Related Estimators.” Journal of Educational Statistics 6 (2). American Educational Research Association (AERA): 107–28. doi:10.3102/10769986006002107.

Hettinger, Thomas P. 2010. “Misconduct: Don’t Assume Science Is Self-Correcting.” Nature 466 (7310): 1040. doi:10.1038/4661040b.

Hicks, Diana, Paul Wouters, Ludo Waltman, Sarah de Rijcke, and Ismael Rafols. 2015. “Bibliometrics: The Leiden Manifesto for Research Metrics.” Nature 520 (7548). Springer Nature: 429–31. doi:10.1038/520429a.

Hill, Theodore P. 1995. “A Statistical Derivation of the Significant-Digit Law.” Statistical Science 10 (4). Institute of Mathematical Statistics: 354–63. http://www.jstor.org/stable/2246134.

Hill, Theodore P., and Klaus Schürger. 2005. “Regularity of Digits and Significant Digits of Random Variables.” Stochastic Processes and Their Applications 115 (10). Elsevier BV: 1723–43. doi:10.1016/j.spa.2005.05.003.

Hobbes, Thomas. 1651. Leviathan. Oxford University Presss.

Hoekstra, Rink, Sue Finch, Henk A. L. Kiers, and Addie Johnson. 2006. “Probability as Certainty: Dichotomous Thinking and the Misuse Ofp Values.” Psychonomic Bulletin & Review 13 (6). Springer Nature: 1033–7. doi:10.3758/bf03213921.

Hogg, Robert V, and Elliot A Tanis. 2001. Probability and Statistical Inference. New Jersey, NJ: Prentice-Hall.

Holcombe, Alex O. 2019. “Contributorship, Not Authorship,” April. Center for Open Science. doi:10.31234/osf.io/dt6e8.

Holman, Luke. 2015. “Reply to Bishop and Thompson,” August. doi:10.6084/m9.figshare.1500901.v1.

Hüllemann, S., G. Schüpfer, and J. Mauch. 2017. “Application of Benford’s Law: A Valuable Tool for Detecting Scientific Papers with Fabricated Data?” Der Anaesthesist 66 (10). Springer Nature: 795–802. doi:10.1007/s00101-017-0333-1.

Hyde, Janet Shibley. 2005. “The Gender Similarities Hypothesis.” American Psychologist 60 (6). American Psychological Association (APA): 581–92. doi:10.1037/0003-066x.60.6.581.

Ioannidis, J. P. A. 2013. “Discussion: Why ‘an Estimate of the Science-Wise False Discovery Rate and Application to the Top Medical Literature’ Is False.” Biostatistics 15 (1). Oxford University Press (OUP): 28–36. doi:10.1093/biostatistics/kxt036.

Ioannidis, John P. A. 2005. “Why Most Published Research Findings Are False.” PLoS Medicine 2 (8). Public Library of Science (PLoS): e124. doi:10.1371/journal.pmed.0020124.

Ioannidis, John PA, and Thomas A Trikalinos. 2007. “An Exploratory Test for an Excess of Significant Findings.” Clinical Trials: Journal of the Society for Clinical Trials 4 (3). SAGE Publications: 245–53. doi:10.1177/1740774507079441.

IPCC. 2018. “Global Warming of 1.5c. an Ipcc Special Report on the Impacts of Global Warming of 1.5c Above Pre-Industrial Levels and Related Global Greenhouse Gas Emission Pathways, in the Context of Strengthening the Global Response to the Threat of Climate Change, Sustainable Development, and Efforts to Eradicate Poverty.” https://www.ipcc.ch/report/sr15/.

Ivarsson, Andreas, Mark B. Andersen, Urban Johnson, and Magnus Lindwall. 2013. “To Adjust or Not Adjust: Nonparametric Effect Sizes, Confidence Intervals, and Real-World Meaning.” Psychology of Sport and Exercise 14 (1). Elsevier BV: 97–102. doi:10.1016/j.psychsport.2012.07.007.

Jacowitz, Karen E, and Daniel Kahneman. 1995. “Measures of Anchoring in Estimation Tasks.” Personality & Social Psychology Bulletin 21. SAGE PERIODICALS PRESS: 1161–6. doi:10.1037/e722982011-058.

Jager, L. R., and J. T. Leek. 2013. “An Estimate of the Science-Wise False Discovery Rate and Application to the Top Medical Literature.” Biostatistics 15 (1). Oxford University Press (OUP): 1–12. doi:10.1093/biostatistics/kxt007.

John, Leslie K, George Loewenstein, and Drazen Prelec. 2012. “Measuring the prevalence of questionable research practices with incentives for truth telling.” Psychological Science 23 (5): 524–32. doi:10.1177/0956797611430953.

Johnson, Valen E., Richard D. Payne, Tianying Wang, Alex Asher, and Soutrik Mandal. 2016. “On the Reproducibility of Psychological Science.” Journal of the American Statistical Association 112 (517). Informa UK Limited: 1–10. doi:10.1080/01621459.2016.1240079.

Johnston, Paul. 2016. “Jatdown: A Markdown Language for Writing Jats.” Journal Article Tag Suite Conference (JATS-Con) Proceedings 2016 [Internet]. https://www.ncbi.nlm.nih.gov/books/NBK350677/.

“Joint Editors-in-Chief request for determination regarding papers published by Dr. Yoshitaka Fujii.” 2013. International Journal of Obstetric Anesthesia 22 (1). Elsevier BV: e1–e21. doi:10.1016/j.ijoa.2012.10.001.

Jones, Shawn M., Herbert Van de Sompel, Harihar Shankar, Martin Klein, Richard Tobin, and Claire Grover. 2016. “Scholarly Context Adrift: Three Out of Four URI References Lead to Changed Content.” Edited by Neil R. Smalheiser. PLOS ONE 11 (12). Public Library of Science (PLoS): e0167475. doi:10.1371/journal.pone.0167475.

Kaiser, Jocelyn. 2017. “Are Preprints the Future of Biology? A Survival Guide for Scientists.” Science, September. American Association for the Advancement of Science (AAAS). doi:10.1126/science.aaq0747.

Kerr, Norbert L. 1998. “HARKing: Hypothesizing After the Results Are Known.” Personality and Social Psychology Review 2 (3). SAGE Publications: 196–217. doi:10.1207/s15327957pspr0203_4.

Kevles, Daniel J. 2000. The Baltimore Case: A Trial of Politics, Science, and Character. WW Norton & Company.

Kharasch, E. D., and T. H. Houle. 2017a. “Errors and Integrity in Seeking and Reporting Apparent Research Misconduct.” Anesthesiology 127 (5). Ovid Technologies (Wolters Kluwer Health): 733–37. doi:10.1097/aln.0000000000001875.

Kharasch, E. D., and T. T. Houle. 2017b. “Seeking and Reporting Apparent Research Misconduct: Errors and Integrity.” Anaesthesia 73 (1). Wiley: 125–26. doi:10.1111/anae.14147.

Khoo, Shaun Yon-Seng. 2019. “Article Processing Charge Hyperinflation and Price Insensitivity: An Open Access Sequel to the Serials Crisis.” LIBER Quarterly 29 (1). Uopen Journals: 1. doi:10.18352/lq.10280.

Kiefer, Randy S. 2015. “Digital Preservation of Scholarly Content, Focusing on the Example of the CLOCKSS Archive.” Insights the UKSG Journal 28 (1). Ubiquity Press, Ltd.: 91–96. doi:10.1629/uksg.215.

Kircz, Joost G. 1998. “Modularity: The Next Form of Scientific Information Presentation?” Journal of Documentation 54 (2). Emerald: 210–35. doi:10.1108/eum0000000007185.

Klein, Martin, Herbert Van de Sompel, Robert Sanderson, Harihar Shankar, Lyudmila Balakireva, Ke Zhou, and Richard Tobin. 2014. “Scholarly Context Not Found: One in Five Articles Suffers from Reference Rot.” Edited by JuditEditor Bar-Ilan. PLoS ONE 9 (12). Public Library of Science (PLoS): e115253. doi:10.1371/journal.pone.0115253.

Klein, Richard A., Kate A Ratliff, Michelangelo Vianello, Reginald B Adams Jr., Štěpán Bahník, Michael J Bernstein, Konrad Bocian, et al. 2014. “Investigating Variation in Replicability.” Social Psychology 45 (3): 142–52. doi:10.1027/1864-9335/a000178.

Kling, Rob, and Ewa Callahan. 2005. “Electronic Journals, the Internet, and Scholarly Communication.” Annual Review of Information Science and Technology 37 (1). Wiley: 127–77. doi:10.1002/aris.1440370105.

Koppelman-White, Elysa. 2006. “Research Misconduct and the Scientific Process: Continuing Quality Improvement.” Accountability in Research 13 (3): 225–46. doi:10.1080/08989620600848611.

Koppers, Lars, Holger Wormer, and Katja Ickstadt. 2016. “Towards a Systematic Screening Tool for Quality Assurance and Semiautomatic Fraud Detection for Images in the Life Sciences.” Science and Engineering Ethics, November. Springer Nature. doi:10.1007/s11948-016-9841-7.

Kornfeld, Donald S. 2012. “Research Misconduct: The Search for a Remedy.” Academic Medicine 87 (7): 877–82. doi:10.1097/ACM.0b013e318257ee6a.

Kraker, Peter, Christopher Kittel, and Asura Enkhbayar. 2016. “Open Knowledge Maps: Creating a Visual Interface to the World’s Scientific Knowledge Based on Natural Language Processing.” 027.7 Zeitschrift Für Bibliothekskultur / Journal for Library Culture 4 (2): 98–103. doi:10.12685/027.7-4-2-157.

Kranke, P. 2012. “Putting the Record Straight: Granisetron’s Efficacy as an Antiemetic ‘Post-Fujii’.” Anaesthesia 67 (10). Wiley-Blackwell: 1063–7. doi:10.1111/j.1365-2044.2012.07318.x.

Kranke, Peter, Christian C. Apfel, and Norbert Roewer. 2000. “Reported Data on Granisetron and Postoperative Nausea and Vomiting by Fujii et Al. Are Incredibly Nice!” Anesthesia & Analgesia 90 (4). Ovid Technologies (Wolters Kluwer Health): 1004. doi:10.1213/00000539-200004000-00053.

Krawczyk, Michał. 2015. “The Search for Significance: A Few Peculiarities in the Distribution of P Values in Experimental Psychology Literature.” Edited by DanieleEditor Fanelli. PLOS ONE 10 (6). Public Library of Science (PLoS): e0127872. doi:10.1371/journal.pone.0127872.

Krawczyk, Michal, and Ernesto Reuben. 2012. “(Un)available Upon Request: Field Experiment on Researchers’ Willingness to Share Supplementary Materials.” Accountability in Research 19 (3): 175–86. doi:10.1080/08989621.2012.678688.

Kühberger, Anton, Astrid Fritz, and Thomas Scherndl. 2014. “Publication Bias in Psychology: A Diagnosis Based on the Correlation Between Effect Size and Sample Size.” Edited by DanieleEditor Fanelli. PLoS ONE 9 (9). Public Library of Science (PLoS): e105825. doi:10.1371/journal.pone.0105825.

Kuhn, Tobias, Christine Chichester, Michael Krauthammer, Núria Queralt-Rosinach, Ruben Verborgh, George Giannakopoulos, Axel-Cyrille Ngonga Ngomo, Raffaele Viglianti, and Michel Dumontier. 2016. “Decentralized Provenance-Aware Publishing with Nanopublications.” PeerJ Computer Science 2 (August). PeerJ: e78. doi:10.7717/peerj-cs.78.

LaCour, M. J., and D. P. Green. 2014. “When Contact Changes Minds: An Experiment on Transmission of Support for Gay Equality.” Science 346 (6215). American Association for the Advancement of Science (AAAS): 1366–9. doi:10.1126/science.1256151.

Lakens, Daniël. 2015a. “Comment: What P-Hacking Really Looks Like: A Comment on Masicampo and Lalande (2012).” Quarterly Journal of Experimental Psychology 68 (4). SAGE Publications: 829–32. doi:10.1080/17470218.2014.982664.

———. 2015b. “On the Challenges of Drawing Conclusions Fromp-Values Just Below 0.05.” PeerJ 3 (July). PeerJ: e1142. doi:10.7717/peerj.1142.

Lane, David M., and William P. Dunlap. 1978. “Estimating Effect Size: Bias Resulting from the Significance Criterion in Editorial Decisions.” British Journal of Mathematical and Statistical Psychology 31 (2). Wiley: 107–12. doi:10.1111/j.2044-8317.1978.tb00578.x.

Larivière, Vincent, Stefanie Haustein, and Philippe Mongeon. 2015. “The Oligopoly of Academic Publishers in the Digital Era.” PLOS ONE 10 (6). Public Library of Science (PLoS): e0127502. doi:10.1371/journal.pone.0127502.

Latour, Bruno, and Steve Woolgard. 1986. Laboratory Life: The Construction of Scientific Facts. Princeton, NJ: Princeton University Press. http://aacoa.net/bookinfo/laboratory-life-the-construction-of-scientific-facts.pdf/.

Leggett, Nathan C., Nicole A. Thomas, Tobias Loetscher, and Michael E. R. Nicholls. 2013. “The Life of P: ‘Just Significant’ Results Are on the Rise.” Quarterly Journal of Experimental Psychology 66 (12). SAGE Publications: 2303–9. doi:10.1080/17470218.2013.863371.

Levelt. 2012. “Flawed science: The fraudulent research practices of social psychologist Diederik Stapel.” https://www.commissielevelt.nl/.

Levelt Committee, Drenth Committee, and Noort, Committee. 2012. “Flawed Science: The Fraudulent Research Practices of Social Psychologist Diederik Stapel.” https://www.commissielevelt.nl/.

Loadsman, J. A., and T. J. McCulloch. 2017. “Widening the Search for Suspect Data - Is the Flood of Retractions About to Become a Tsunami?” Anaesthesia 72 (8). Wiley: 931–35. doi:10.1111/anae.13962.

Lu, Susan Feng, Ginger Zhe Jin, Brian Uzzi, and Benjamin Jones. 2013. “The Retraction Penalty: Evidence from the Web of Science.” Scientific Reports 3 (6~nov): 3146. doi:10.1038/srep03146.

Lubalin, James S, and Jennifer L Matheson. 1999. “The Fallout: What Happens to Whistleblowers and Those Accused but Exonerated of Scientific Misconduct?” Science and Engineering Ethics 5 (2). Kluwer Academic Publishers: 229–50. doi:10.1007/s11948-999-0014-9.

Lubalin, James S, Mary-Anne E Ardini, and Jennifer L Matheson. 1995. “Consequences of Whistleblowing for the Whistleblower in Misconduct in Science Cases.” Research Triangle Institute. http://web.archive.org/web/20150819064509/https://ori.hhs.gov/sites/default/files/final.pdf.

Mahoney, Michael J. 1977. “Publication Prejudices: An Experimental Study of Confirmatory Bias in the Peer Review System.” Cognitive Therapy and Research 1 (2). Springer Nature: 161–75. doi:10.1007/bf01173636.

Makel, Matthew C, Jonathan A Plucker, and Boyd Hegarty. 2012. “Replications in Psychology Research: How Often Do They Really Occur?” Perspectives on Psychological Science 7 (6): 537–42. doi:10.1177/1745691612460688.

Marcus, Adam, and Ivan Oransky. 2014. “What Studies of Retractions Tell Us.” Journal of Microbiology & Biology Education 15 (2): 151–54. doi:10.1128/jmbe.v15i2.855.

Margraf, Jürgen. 2015. “Zur Lage Der Psychologie.” Psychologische Rundschau; Ueberblick Uber Die Fortschritte Der Psychologie in Deutschland, Oesterreich, Und Der Schweiz 66 (1): 1–30. doi:10.1026/0033-3042/a000247.

Marszalek, Jacob M., Carolyn Barber, Julie Kohlhart, and B. Holmes Cooper. 2011. “Sample Size in Psychological Research over the Past 30 Years.” Perceptual and Motor Skills 112 (2). SAGE Publications: 331–48. doi:10.2466/03.11.pms.112.2.331-348.

Mascha, Edward J., Thomas R. Vetter, and Jean-Francois Pittet. 2017. “An Appraisal of the Carlisle-Stouffer-Fisher Method for Assessing Study Data Integrity and Fraud.” Anesthesia & Analgesia 125 (4). Ovid Technologies (Wolters Kluwer Health): 1381–5. doi:10.1213/ane.0000000000002415.

Masicampo, E.J., and Daniel R. Lalande. 2012. “A Peculiar Prevalence of P Values Just Below .05.” Quarterly Journal of Experimental Psychology 65 (11). SAGE Publications: 2271–9. doi:10.1080/17470218.2012.711335.

Massey, Frank J. 1951. “The Kolmogorov-Smirnov Test for Goodness of Fit.” Journal of the American Statistical Association 46 (253). JSTOR: 68. doi:10.2307/2280095.

Maxwell, Scott E., Michael Y. Lau, and George S. Howard. 2015. “Is Psychology Suffering from a Replication Crisis? What Does ‘Failure to Replicate’ Really Mean?” American Psychologist 70 (6). American Psychological Association (APA): 487–98. doi:10.1037/a0039400.

Mazar, Nina, On Amir, and Dan Ariely. 2008. “The Dishonesty of Honest People: A Theory of Self-Concept Maintenance.” Journal of Marketing Research 45 (6). American Marketing Association (AMA): 633–44. doi:10.1509/jmkr.45.6.633.

McKenzie, Lindsay. 2017. “Swipe Right for Science: Papr App Is ‘Tinder for Preprints’.” Nature, June. Springer Nature. doi:10.1038/nature.2017.22163.

McNutt, M. 2015. “Editorial Expression of Concern.” Science 348 (6239). American Association for the Advancement of Science (AAAS): 1100–1100. doi:10.1126/science.aac6184.

Meehl, Paul E. 2004. “Theoretical Risks and Tabular Asterisks: Sir Karl, Sir Ronald, and the Slow Progress of Soft Psychology.” Applied and Preventive Psychology 11 (1). Elsevier BV: 1. doi:10.1016/j.appsy.2004.02.001.

Merton, Robert K. 1942. “A Note on Science and Democracy.” J. Legal & Pol. Soc. 1. HeinOnline: 115.

Miller, D. R. 2015. “Probability Screening in Manuscripts Submitted to Biomedical Journals - an Effective Tool or a Statistical Quagmire?” Anaesthesia 70 (7). Wiley: 765–68. doi:10.1111/anae.13165.

Mills, James L. 1993. “Data Torturing.” New England Journal of Medicine 329 (16). New England Journal of Medicine (NEJM/MMS): 1196–9. doi:10.1056/nejm199310143291613.

Mitroff, Ian I. 1974. “Norms and Counter-Norms in a Select Group of the Apollo Moon Scientists: A Case Study of the Ambivalence of Scientists.” American Sociological Review 39 (4). American Sociological Association: 579–95. doi:10.2307/2094423.

Moppett, I. K. 2017. “Errors in Published Papers Are Multifactorial.” Anaesthesia 72 (11). Wiley: 1415–6. doi:10.1111/anae.14048.

Morel, Carlos Medicis, Suzanne Jacob Serruya, Gerson Oliveira Penna, and Reinaldo Guimarães. 2009. “Co-Authorship Network Analysis: A Powerful Tool for Strategic Planning of Research, Development and Capacity Building Programs on Neglected Diseases.” Edited by MarcelEditor Tanner. PLoS Neglected Tropical Diseases 3 (8). Public Library of Science (PLoS): e501. doi:10.1371/journal.pntd.0000501.

Morey, Richard D., and Jeffrey N. Rouder. 2015. BayesFactor: Computation of Bayes Factors for Common Designs. https://CRAN.R-project.org/package=BayesFactor.

Mosimann, James E, Claire V Wiseman, and Ruth E Edelman. 1995. “Data Fabrication: Can People Generate Random Digits?” Accountability in Research 4 (1): 31–55. doi:10.1080/08989629508573866.

Mosimann, James E., and Makarand V. Ratnaparkhi. 1996. “Uniform Occurrence of Digits for Folded and Mixture Distributions on Finite Intervals.” Communications in Statistics - Simulation and Computation 25 (2). Informa UK Limited: 481–506. doi:10.1080/03610919608813325.

Mosimann, James, John Dahlberg, Nancy Davidian, and John Krueger. 2002. “Terminal Digits and the Examination of Questioned Data.” Accountability in Research 9 (2): 75–92. doi:10.1080/08989620212969.

Mosteller, Frederick, and R. A. Fisher. 1948. “Questions and Answers.” The American Statistician 2 (5). [American Statistical Association, Taylor & Francis, Ltd.]: 30–31. http://www.jstor.org/stable/2681650.

Munafò, Marcus R., Brian A. Nosek, Dorothy V. M. Bishop, Katherine S. Button, Christopher D. Chambers, Nathalie Percie du Sert, Uri Simonsohn, Eric-Jan Wagenmakers, Jennifer J. Ware, and John P. A. Ioannidis. 2017. “A Manifesto for Reproducible Science.” Nature Human Behaviour 1 (1). Springer Nature: 0021. doi:10.1038/s41562-016-0021.

National Academy of Sciences, National Academy of Engineering, and Institute of Medicine. 1992. Responsible Science, Volume I: Ensuring the Integrity of the Research Process. Washington, DC: The National Academies Press. doi:10.17226/1864.

Nature editors. 2017. “Image Doctoring Must Be Halted.” Nature 546 (7660). Springer Nature: 575–75. doi:10.1038/546575a.

Newcomb, Simon. 1881. “Note on the Frequency of Use of the Different Digits in Natural Numbers.” American Journal of Mathematics 4 (1/4). JSTOR: 39. doi:10.2307/2369148.

Nickerson, Raymond S. 1998. “Confirmation Bias: A Ubiquitous Phenomenon in Many Guises.” Review of General Psychology 2 (2). American Psychological Association (APA): 175–220. doi:10.1037/1089-2680.2.2.175.

———. 2000. “Null Hypothesis Significance Testing: A Review of an Old and Continuing Controversy.” Psychological Methods 5 (2). American Psychological Association (APA): 241–301. doi:10.1037/1082-989x.5.2.241.

Nielsen, Michael. 2012. Reinventing Discover: The New Era of Networked Science. Princeton University Press.

Nigrini, Mark. 2015. “Chapter Eight. Detecting Fraud and Errors Using Benford’s Law.” In Benfords Law, edited by Steven J. Miller. Princeton University Press. doi:10.1515/9781400866595-011.

Nissim, Nir, Aviad Cohen, Jian Wu, Andrea Lanzi, Lior Rokach, Yuval Elovici, and Lee Giles. 2017. “Scholarly Digital Libraries as a Platform for Malware Distribution.” Cryptology and Information Security Series, 107–28. doi:10.3233/978-1-61499-744-3-107.

Nosek, B A, G Alter, G C Banks, D Borsboom, S D Bowman, S J Breckler, S Buck, et al. 2015. “Promoting an Open Research Culture.” Science 348 (6242): 1422–5. doi:10.1126/science.aab2374.

Nosek, Brian A, and Yoav Bar-Anan. 2012. “Scientific Utopia: I. Opening Scientific Communication.” Psychological Inquiry 23 (3). Taylor & Francis: 217–43. doi:10.1080/1047840X.2012.692215.

Nosek, Brian A, Jeffrey R Spies, and Matt Motyl. 2012. “Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth over Publishability.” Perspectives on Psychological Science 7 (6): 615–31. doi:10.1177/1745691612459058.

Nosek, Brian A., Charles R. Ebersole, Alexander C. DeHaven, and David T. Mellor. 2018. “The Preregistration Revolution.” Proceedings of the National Academy of Sciences 115 (11). Proceedings of the National Academy of Sciences: 2600–2606. doi:10.1073/pnas.1708274114.

Nuijten, Michèle B., Chris H. J. Hartgerink, Marcel A.L.M. Van Assen, Epskamp Sacha, and Jelte M. Wicherts. 2015. “The Prevalence of Statistical Reporting Errors in Psychology (1985–2013).” Behavior Research Methods 48 (4). Springer Nature: 1205–26. doi:10.3758/s13428-015-0664-2.

Nuijten, Michèle B., Marcel A. L. M. Van Assen, Coosje L. S. Veldkamp, and Jelte M. Wicherts. 2015. “The Replication Paradox: Combining Studies Can Decrease Accuracy of Effect Size Estimates.” Review of General Psychology 19 (2). American Psychological Association (APA): 172–82. doi:10.1037/gpr0000034.

O’Brien, Susan Patricia, and Danny Chan, Frederick Leung, Eun Jung Ko, Jin Sun Kwak, TaeHwan Gwon, Ji Min Lee, et al. 2016. “Proceedings of the 4th World Conference on Research Integrity.” Research Integrity and Peer Review 1 (S1). Springer Nature. doi:10.1186/s41073-016-0012-9.

Office of Science and Technology Policy. 2000. “Federal Policy on Research Misconduct.” https://web.archive.org/web/20150910131244/https://www.federalregister.gov/articles/2000/12/06/00-30852/executive-office-of-the-president-federal-policy-on-research-misconduct-preamble-for-research#h-16.

Ogden, Maxwell. 2017. “Dat - Distributed Dataset Synchronization and Versioning,” January. Center for Open Science. doi:10.31219/osf.io/nsv2c.

Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349 (6251). doi:10.1126/science.aac4716.

Oransky, Ivan. 2015. “The Retraction Watch Leaderboard.” http://wayback.archive.org/web/20170206163805/http://retractionwatch.com/the-retraction-watch-leaderboard/.

Parker, A., and J.O. Hamblen. 1989. “Computer Algorithms for Plagiarism Detection.” IEEE Transactions on Education 32 (2). Institute of Electrical; Electronics Engineers (IEEE): 94–99. doi:10.1109/13.28038.

Pashler, Harold, and Eric–Jan Wagenmakers. 2012. “Editors’ Introduction to the Special Section on Replicability in Psychological Science.” Perspectives on Psychological Science 7 (6). SAGE Publications: 528–30. doi:10.1177/1745691612465253.

Pautasso, Marco. 2010. “Worsening File-Drawer Problem in the Abstracts of Natural, Medical and Social Science Databases.” Scientometrics 85 (1). Springer Nature: 193–202. doi:10.1007/s11192-010-0233-5.

Peeters, C A W, C A J Klaassen, and M A van de Wiel. 2015. “Meta-Response to Public Discussions of the Investigation into Publications by Dr. Förster.” University of Amsterdam. https://wayback.archive.org/web/20180709102400/https://www.uva.nl/binaries/content/assets/uva/nl/persvoorlichting/uva-nieuws/meta-response.pdf?1436179086511.

Peiffer, Ann M, Christina E Hugenschmidt, and Paul J Laurienti. 2011. “Ethics in 15 Min Per Week.” Science and Engineering Ethics 17 (2): 289–97. doi:10.1007/s11948-010-9197-3.

Pfeifer, M P, and G L Snodgrass. 1990. “The Continued Use of Retracted, Invalid Scientific Literature.” JAMA 263 (10): 1420–3. doi:10.1001/jama.1990.03440100140020.

Philips, Tom. 2017. “Publishers Need to Stop Using Insecure Http.” The Guardian. https://wayback.archive.org/web/20180809112257/https://www.theguardian.com/world/2017/aug/19/cambridge-university-press-accused-of-selling-its-soul-over-chinese-censorship.

Piraino, Scott W. 2017. “Issues in the Statistical Detection of Data Fabrication and Data Errors in the Scientific Literature: Simulation Study and Reanalysis of Carlisle, 2017,” August. Cold Spring Harbor Laboratory. doi:10.1101/179135.

Pirani, Simon. 2018. Burning up.

Piwowar, Heather, Jason Priem, Vincent Larivière, Juan Pablo Alperin, Lisa Matthias, Bree Norlander, Ashley Farley, Jevin West, and Stefanie Haustein. 2018. “The State of OA: A Large-Scale Analysis of the Prevalence and Impact of Open Access Articles.” PeerJ 6 (February). PeerJ: e4375. doi:10.7717/peerj.4375.

Plemmons, Dena K, Suzanne A Brody, and Michael W Kalichman. 2006. “Student Perceptions of the Effectiveness of Education in the Responsible Conduct of Research.” Science and Engineering Ethics 12 (3): 571–82. doi:10.1007/s11948-006-0055-2.

Popper, Karl. 2002. The Logic of Scientific Discovery (Routledge Classics). Routledge.

Prathap, Gangan, S. Mini, and P. Nishy. 2016. “Does High Impact Factor Successfully Predict Future Citations? An Analysis Using Peirce’s Measure.” Scientometrics 108 (3). Springer Nature: 1043–7. doi:10.1007/s11192-016-2034-y.

Price, A R. 1998. “Anonymity and Pseudonymity in Whistleblowing to the U.s. Office of Research Integrity.” Academic Medicine 73 (5): 467–72. doi:10.1097/00001888-199805000-00009.

Priem, Jason, and Bradley M. Hemminger. 2012. “Decoupling the Scholarly Journal.” Frontiers in Computational Neuroscience 6. Frontiers Media SA. doi:10.3389/fncom.2012.00019.

Reich, Vicky, and David S. H. Rosenthal. 2001. “LOCKSS.” D-Lib Magazine 7 (6). CNRI Acct. doi:10.1045/june2001-reich.

Resnik, David B, and C Neal Stewart Jr. 2012. “Misconduct Versus Honest Error and Scientific Disagreement.” Accountability in Research 19 (1): 56–63. doi:10.1080/08989621.2012.650948.

“Retraction of ‘the Secret Life of Emotions’ and ‘Emotion Elicitor or Emotion Messenger? Subliminal Priming Reveals Two Faces of Facial Expressions’.” 2012. Psychological Science 23 (7): 828–28. doi:10.1177/0956797612453137.

Rhoades, Lawrence J. 2004. “ORI Closed Investigations into Misconduct Allegations Involving Research Supported by the Public Health Service: 1994-2003.” Office of Research Integrity; ori.hhs.gov. https://wayback.archive.org/web/20180709101834/https://ori.hhs.gov/sites/default/files/Investigations1994-2003-2.pdf.

Ridley, J., N. Kolm, R. P. Freckelton, and M. J. G. Gage. 2007. “An Unexpected Influence of Widely Used Significance Thresholds on the Distribution of Reported P-Values.” Journal of Evolutionary Biology 20 (3). Wiley: 1082–9. doi:10.1111/j.1420-9101.2006.01291.x.

Robin, Xavier, Natacha Turck, Alexandre Hainard, Natalia Tiberti, Frédérique Lisacek, Jean-Charles Sanchez, and Markus Müller. 2011. “PROC: An Open-Source Package for R and S+ to Analyze and Compare Roc Curves.” BMC Bioinformatics 12 (1). Springer Nature: 77. doi:10.1186/1471-2105-12-77.

Robinson, Danielle C., Joe A. Hand, Mathias Buus Madsen, and Karissa R. McKelvey. 2018. “The Dat Project, an Open and Decentralized Research Data Tool.” Scientific Data 5 (October). Springer Nature: 180221. doi:10.1038/sdata.2018.221.

Roosendaal, Hans E, and Peter A Th M Geurts. 1998. “Forces and Functions in Scientific Communication: An Analysis of Their Interplay.” http://web.archive.org/web/20180223112609/http://www.physik.uni-oldenburg.de/conferences/crisp97/roosendaal.html.

Rosenthal, Robert. 1979. “The File Drawer Problem and Tolerance for Null Results.” Psychological Bulletin 86 (3). American Psychological Association (APA): 638–41. doi:10.1037/0033-2909.86.3.638.

Rossner, Mike, and Kenneth M Yamada. 2004. “What’s in a Picture? The Temptation of Image Manipulation.” The Journal of Cell Biology 166 (1): 11–15. doi:10.1083/jcb.200406019.

Rothstein, Hannah. 2005. Publication Bias in Meta-Analysis : Prevention, Assessment and Adjustments. Chichester, England Hoboken, NJ: Wiley.

Ruys, Kirsten I, and Diederik A Stapel. 2008. “Emotion Elicitor or Emotion Messenger?: Subliminal Priming Reveals Two Faces of Facial Expressions [Retracted].” Psychological Science 19 (6): 593–600. doi:10.1111/j.1467-9280.2008.02128.x.

Savage, Caroline J, and Andrew J Vickers. 2009. “Empirical Study of Data Sharing by Authors Publishing in PLoS Journals.” PloS ONE 4 (9): e7078. doi:10.1371/journal.pone.0007078.

Schimmack, Ulrich. 2012. “The Ironic Effect of Significant Results on the Credibility of Multiple-Study Articles.” Psychological Methods 17 (4). American Psychological Association (APA): 551–66. doi:10.1037/a0029487.

Sedlmeier, Peter, and Gerd Gigerenzer. 1989. “Do Studies of Statistical Power Have an Effect on the Power of Studies?” Psychological Bulletin 105 (2). American Psychological Association (APA): 309–16. doi:10.1037/0033-2909.105.2.309.

Seeber, Marco, Mattia Cattaneo, Michele Meoli, and Paolo Malighetti. 2017. “Self-Citations as Strategic Response to the Use of Metrics for Career Decisions.” Research Policy, December. Elsevier BV. doi:10.1016/j.respol.2017.12.004.

Seglen, P. O. 1992. “The skewness of science.” Journal of the American Society for Information Science 43: 628–38.

———. 1994. “Causal relationship between article citedness and journal impact.” Journal of the American Society for Information Science, 45: 1–11.

Seife, Charles. 2015. “Research Misconduct Identified by the US Food and Drug Administration: Out of Sight, Out of Mind, Out of the Peer-Reviewed Literature.” JAMA Internal Medicine 175 (4): 567–77. doi:10.1001/jamainternmed.2014.7774.

Shamoo, A E, and D B Resnik. 2009. Responsible Conduct of Research. New York, NY: Oxford University Press.

Shamoo, Adil E. 2006. “Data Audit Would Reduce Unethical Behaviour.” Nature 439 (7078): 784. doi:10.1038/439784c.

Sijtsma, Klaas, Coosje L S Veldkamp, and Jelte M Wicherts. 2015. “Improving the Conduct and Reporting of Statistical Analysis in Psychology.” Psychometrika, 28~mar. doi:10.1007/s11336-015-9444-2.

Simmons, Joseph P, Leif D Nelson, and Uri Simonsohn. 2011. “False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant.” Psychological Science 22 (11): 1359–66. doi:10.1177/0956797611417632.

Simonsohn, Uri. 2013. “Just Post It: The Lesson from Two Cases of Fabricated Data Detected by Statistics Alone.” Psychological Science 24 (10): 1875–88. doi:10.1177/0956797613480366.

Simonsohn, Uri, Leif D. Nelson, and Joseph P. Simmons. 2014. “P-Curve: A Key to the File-Drawer.” Journal of Experimental Psychology: General 143 (2). American Psychological Association (APA): 534–47. doi:10.1037/a0033242.

Simonsohn, Uri, Joseph P. Simmons, and Leif D. Nelson. 2015. “Better P-Curves: Making P-Curve Analysis More Robust to Errors, Fraud, and Ambitious P-Hacking, a Reply to Ulrich and Miller (2015).” Journal of Experimental Psychology: General 144 (6). American Psychological Association (APA): 1146–52. doi:10.1037/xge0000104.

Smaldino, Paul E., and Richard McElreath. 2016. “The Natural Selection of Bad Science.” Royal Society Open Science 3 (9). The Royal Society: 160384. doi:10.1098/rsos.160384.

Smithson, Michael. 2001. “Correct Confidence Intervals for Various Regression Effect Sizes and Parameters: The Importance of Noncentral Distributions in Computing Intervals.” Educational and Psychological Measurement 61 (4). SAGE Publications: 605–32. doi:10.1177/00131640121971392.

Sompel, Herbert Van de. 2006. “Certification in a Digital Era.” Nature. Springer Nature. doi:10.1038/nature05008.

Sompel, Herbert Van de, Sandy Payette, John Erickson, Carl Lagoze, and Simeon Warner. 2004. “Rethinking Scholarly Communication.” D-Lib Magazine 10 (9). CNRI Acct. doi:10.1045/september2004-vandesompel.

Spellman, Barbara A. 2012. “Scientific Utopia … or Too Much Information? Comment on Nosek and Bar-Anan.” Psychological Inquiry 23 (3). Informa UK Limited: 303–4. doi:10.1080/1047840x.2012.701161.

———. 2015. “A Short (Personal) Future History of Revolution 2.0.” Perspectives on Psychological Science 10 (6). SAGE Publications: 886–99. doi:10.1177/1745691615609918.

Spies, Jeffrey Robert. 2017. “The Open Science Framework: Improving Science by Making It Open and Accessible,” April. Center for Open Science. doi:10.31237/osf.io/t23za.

Standish, E. M. 2004. “The Astronomical Unit Now.” Proceedings of the International Astronomical Union 2004 (IAUC196). Cambridge University Press (CUP): 163–79. doi:10.1017/s1743921305001365.

Stanley, David J., and Jeffrey R. Spence. 2014. “Expectations for Replications.” Perspectives on Psychological Science 9 (3). SAGE Publications: 305–18. doi:10.1177/1745691614528518.

Stapel, Diederik A. 2012. Ontsporing. Amsterdam, the Netherlands: Prometheus.

Star, Susan Leigh. 1990. “Power, Technology and the Phenomenology of Conventions: On Being Allergic to Onions.” The Sociological Review 38 (1_suppl). SAGE Publications: 26–56. doi:10.1111/j.1467-954x.1990.tb03347.x.

Steiger, James H, and Rachel T Fouladi. 1997. “Noncentrality interval estimation and the evaluation of statistical models.” In What If There Were No Significance Tests, edited by Lisa L. Harlow, Stanley A. Mulaik, and James H Steiger. New York, NY: Psychology Press.

Steneck, Nicholas H. 2006. “Fostering Integrity in Research: Definitions, Current Knowledge, and Future Directions.” Science and Engineering Ethics 12 (1). Springer Nature: 53–74. doi:10.1007/pl00022268.

Sterling, T. D., W. L. Rosenbaum, and J. J. Weinkam. 1995. “Publication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa.” The American Statistician 49 (1). JSTOR: 108. doi:10.2307/2684823.

Sterling, Theodore D. 1959. “Publication Decisions and Their Possible Effects on Inferences Drawn from Tests of Significance–or Vice Versa.” Journal of the American Statistical Association 54 (285). JSTOR: 30. doi:10.2307/2282137.

Sterne, Jonathan A.C, David Gavaghan, and Matthias Egger. 2000. “Publication and Related Bias in Meta-Analysis.” Journal of Clinical Epidemiology 53 (11). Elsevier BV: 1119–29. doi:10.1016/s0895-4356(00)00242-0.

Stewart, W W, and N Feder. 1987. “The Integrity of the Scientific Literature.” Nature 325 (6101): 207–14. doi:10.1038/325207a0.

Stricker, Johannes, and Armin Günther. 2019. “Scientific Misconduct in Psychology.” Zeitschrift Für Psychologie 227 (1). Hogrefe Publishing Group: 53–63. doi:10.1027/2151-2604/a000356.

Stroebe, Wolfgang, Tom Postmes, and Russell Spears. 2012. “Scientific Misconduct and the Myth of Self-Correction in Science.” Perspectives on Psychological Science 7 (6): 670–88. doi:10.1177/1745691612460687.

Stroop, J. R. 1935. “Studies of Interference in Serial Verbal Reactions.” Journal of Experimental Psychology 18 (6). American Psychological Association (APA): 643–62. doi:10.1037/h0054651.

Strubell, Emma, Ananya Ganesh, and Andrew McCallum. 2019. “Energy and Policy Considerations for Deep Learning in NLP.” CoRR abs/1906.02243. http://arxiv.org/abs/1906.02243.

Student. 1908. “THE Probable Error of a Mean.” Biometrika 6 (1). Oxford University Press (OUP): 1–25. doi:10.1093/biomet/6.1.1.

Tennant, Jonathan P., Jonathan M. Dugan, Daniel Graziotin, Damien C. Jacques, François Waldner, Daniel Mietchen, Yehia Elkhatib, et al. 2017. “A Multi-Disciplinary Perspective on Emergent and Future Innovations in Peer Review.” F1000Research 6 (November). F1000 Research, Ltd.: 1151. doi:10.12688/f1000research.12037.3.

“The Impact Factor Game.” 2006. PLoS Medicine 3 (6). Public Library of Science (PLoS): e291. doi:10.1371/journal.pmed.0030291.

The Journal of Cell Biology. 2015a. “About the Journal.” https://web.archive.org/web/20150911132421/http://jcb.rupress.org/site/misc/about.xhtml.

———. 2015b. “About the Journal.” https://web.archive.org/web/20150911132421/http://jcb.rupress.org/site/misc/about.xhtml.

Travers, Jeffrey, and Stanley Milgram. 1969. “An Experimental Study of the Small World Problem.” Sociometry 32 (4). JSTOR: 425. doi:10.2307/2786545.

Tversky, A, and D Kahneman. 1974. “Judgment Under Uncertainty: Heuristics and Biases.” Science 185 (4157): 1124–31. doi:10.1126/science.185.4157.1124.

Tversky, Amos, and Daniel Kahneman. 1971. “Belief in the Law of Small Numbers.” Psychological Bulletin 76 (2). American Psychological Association (APA): 105–10. doi:10.1037/h0031322.

Ulrich, Rolf, and Jeff Miller. 2015. “P-Hacking by Post Hoc Selection with Multiple Opportunities: Detectability by Skewness Test?: Comment on Simonsohn, Nelson, and Simmons (2014).” Journal of Experimental Psychology: General 144 (6). American Psychological Association (APA): 1137–45. doi:10.1037/xge0000086.

Urbina, Mauricio A., Andrew J. R. Watts, and Erin E. Reardon. 2015. “Labs Should Cut Plastic Waste Too.” Nature 528 (7583). Springer Science; Business Media LLC: 479–79. doi:10.1038/528479c.

Van Aert, Robbie C. M., and Marcel A. L. M. Van Assen. 2017a. “Bayesian Evaluation of Effect Size After Replicating an Original Study.” Edited by DanieleEditor Marinazzo. PLOS ONE 12 (4). Public Library of Science (PLoS): e0175302. doi:10.1371/journal.pone.0175302.

———. 2017b. “Examining Reproducibility in Psychology: A Hybrid Method for Combining a Statistically Significant Original Study and a Replication.” Behavior Research Methods 50 (4). Springer Nature America, Inc: 1515–39. doi:10.3758/s13428-017-0967-6.

Van Aert, Robbie C. M., Jelte M. Wicherts, and Marcel A. L. M. Van Assen. 2016. “Conducting Meta-Analyses Based on P Values.” Perspectives on Psychological Science 11 (5). SAGE Publications: 713–29. doi:10.1177/1745691616650874.

Van Assen, Marcel A L M, Robbie C M Van Aert, Michèle B. Nuijten, and Jelte M Wicherts. 2014. “Why Publishing Everything Is More Effective Than Selective Publishing of Statistically Significant Results.” PloS ONE 9 (1): e84896. doi:10.1371/journal.pone.0084896.

Van Assen, Marcel A. L. M., Robbie C. M. Van Aert, and Jelte M. Wicherts. 2015. “Meta-Analysis Using Effect Size Distributions of Only Statistically Significant Studies.” Psychological Methods 20 (3). American Psychological Association (APA): 293–309. doi:10.1037/met0000025.

Van Noorden, Richard. 2011. “Science Publishing: The Trouble with Retractions.” Nature 478 (7367): 26–28. doi:10.1038/478026a.

———. 2017. “Science Journals Permit Open-Access Publishing for Gates Foundation Scholars.” Nature, February. Springer Science; Business Media LLC. doi:10.1038/nature.2017.21486.

Vanpaemel, Wolf, Maarten Vermorgen, Leen Deriemaecker, and Gert Storms. 2015. “Are We Wasting a Good Crisis? The Availability of Psychological Research Data After the Storm.” Collabra 1 (1). University of California Press. doi:10.1525/collabra.13.

Veldkamp, Coosje L. S., Chris H. J. Hartgerink, Marcel A. L. M. Van Assen, and Jelte M. Wicherts. 2016. “Who Believes in the Storybook Image of the Scientist?” Accountability in Research 24 (3). Informa UK Limited: 127–51. doi:10.1080/08989621.2016.1268922.

Veldkamp, Coosje L. S., Michèle B. Nuijten, Linda Dominguez-Alvarez, Marcel A. L. M. Van Assen, and Jelte M. Wicherts. 2014. “Statistical Reporting Errors and Collaboration on Statistical Analyses in Psychological Science.” PloS ONE 9 (12): e114876. doi:10.1371/journal.pone.0114876.

Velterop, Jan. 2010. “Nanopublications the Future of Coping with Information Overload.” Logos 21 (3). Brill Academic Publishers: 119–22. doi:10.1163/095796511x560006.

Vermeulen, Ivar, Camiel J. Beukeboom, Anika Batenburg, Arthur Avramiea, Dimo Stoyanov, Bob van de Velde, and Dirk Oegema. 2015. “Blinded by the Light: How a Focus on Statistical ‘Significance’ May Causep-Value Misreporting and an Excess Ofp-Values Just Below .05 in Communication Science.” Communication Methods and Measures 9 (4). Informa UK Limited: 253–79. doi:10.1080/19312458.2015.1096333.

Verschuere, Bruno, Ewout H. Meijer, Ariane Jim, Katherine Hoogesteyn, Robin Orthey, Randy J. McCarthy, John J. Skowronski, et al. 2018. “Registered Replication Report on Mazar, Amir, and Ariely (2008).” Advances in Methods and Practices in Psychological Science, September. SAGE Publications, 251524591878103. doi:10.1177/2515245918781032.

Vines, Timothy H., Arianne Y.K. Albert, Rose L. Andrew, Florence Débarre, Dan G. Bock, Michelle T. Franklin, Kimberly J. Gilbert, Jean-Sébastien Moore, Sébastien Renaut, and Diana J. Rennison. 2014. “The Availability of Research Data Declines Rapidly with Article Age.” Current Biology 24 (1). Elsevier BV: 94–97. doi:10.1016/j.cub.2013.11.014.

Voelkle, Manuel C., Phillip L. Ackerman, and Werner W. Wittmann. 2007. “Effect Sizes and F Ratios < 1.0.” Methodology 3 (1). Hogrefe Publishing Group: 35–46. doi:10.1027/1614-2241.3.1.35.

Wagenaar, W. A. 1972. “Generation of Random Sequences by Human Subjects: A Critical Survey of Literature.” Psychological Bulletin 77 (1). American Psychological Association (APA): 65–72. doi:10.1037/h0032060.

Wagenmakers, Eric-Jan. 2007. “A Practical Solution to the Pervasive Problems Ofp Values.” Psychonomic Bulletin & Review 14 (5). Springer Nature: 779–804. doi:10.3758/bf03194105.

Wagenmakers, Eric-Jan, Ruud Wetzels, Denny Borsboom, Han L J van der Maas, and Rogier A Kievit. 2012. “An Agenda for Purely Confirmatory Research.” Perspectives on Psychological Science 7 (6): 632–38. doi:10.1177/1745691612463078.

Wasserman, Stanley, and Katherine Faust. 1994. Social Network Analysis: Methods and Applications (Structural Analysis in the Social Sciences). Cambridge University Press.

Whitebeck, Caroline. 2001. “Group Mentoring to Foster the Responsible Conduct of Research.” Science and Engineering Ethics 7 (4). Kluwer Academic Publishers: 541–58. doi:10.1007/s11948-001-0012-z.

Wicherts, Jelte M. 2011. “Psychology Must Learn a Lesson from Fraud Case.” Nature 480 (7375): 7. doi:10.1038/480007a.

Wicherts, Jelte M, and Marcel A L M Van Assen. 2012. “Research Fraud: Speed up Reviews of Misconduct.” Nature 488 (7413): 591. doi:10.1038/488591b.

Wicherts, Jelte M., Denny Borsboom, Judith Kats, and Dylan Molenaar. 2006. “The Poor Availability of Psychological Research Data for Reanalysis.” American Psychologist 61 (7). American Psychological Association (APA): 726–28. doi:10.1037/0003-066x.61.7.726.

Wicherts, Jelte M., Chris H. J. Hartgerink, and Raoul P.P.P. Grasman. 2016. “The Growth of Psychology and Its Corrective Mechanisms: A Bibliometric Analysis (1950-2015).” Manuscript in preparation.

Wicherts, Jelte M., Coosje L. S. Veldkamp, Hilde E. M. Augusteijn, Marjan Bakker, Robbie C. M. van Aert, and Marcel A. L. M. van Assen. 2016. “Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid P-Hacking.” Frontiers in Psychology 7 (November). Frontiers Media SA. doi:10.3389/fpsyg.2016.01832.

Wigboldus, Daniel H J, and Ron Dotsch. 2015. “Encourage Playing with Data and Discourage Questionable Reporting Practices.” Psychometrika, 28~mar. doi:10.1007/s11336-015-9445-1.

Wilkinson, Leland. 1999. “Statistical Methods in Psychology Journals: Guidelines and Explanations.” American Psychologist 54 (8). American Psychological Association (APA): 594–604. doi:10.1037/0003-066x.54.8.594.

Wilsdon, James, Liz Allen, Eleonora Belfiore, Philip Campbell, Stephen Curry, Steven Hill, Richard Jones, et al. 2015. “The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management,” July.

Wootton, David. 2015. The Invention of Science: A New History of the Scientific Revolution. Toronto, Canada: Allen Lane.

Wynes, Seth, Simon D. Donner, Steuart Tannason, and Noni Nabors. 2019. “Academic Air Travel Has a Limited Influence on Professional Success.” Journal of Cleaner Production 226 (July). Elsevier BV: 959–67. doi:10.1016/j.jclepro.2019.04.109.

Youngstrom, Eric A. 2013. “A Primer on Receiver Operating Characteristic Analysis and Diagnostic Efficiency Statistics for Pediatric Psychology: We Are Ready to Roc.” Journal of Pediatric Psychology 39 (2). Oxford University Press (OUP): 204–21. doi:10.1093/jpepsy/jst062.

Yule, George Udny. 1922. “An Introduction to the Theory of Statistics.” London, United Kingdom: Griffin. https://ia800205.us.archive.org/13/items/cu31924013993187/cu31924013993187.pdf.

References

Nuijten, Michèle B., Chris H. J. Hartgerink, Marcel A.L.M. Van Assen, Epskamp Sacha, and Jelte M. Wicherts. 2015. “The Prevalence of Statistical Reporting Errors in Psychology (1985–2013).” Behavior Research Methods 48 (4). Springer Nature: 1205–26. doi:10.3758/s13428-015-0664-2.