Files in this item
Statistical model specification and power : recommendations on the use of test-qualified pooling in analysis of experimental data
Item metadata
dc.contributor.author | Colegrave, Nick | |
dc.contributor.author | Ruxton, Graeme D. | |
dc.date.accessioned | 2018-02-22T10:30:08Z | |
dc.date.available | 2018-02-22T10:30:08Z | |
dc.date.issued | 2017-03-29 | |
dc.identifier | 249951372 | |
dc.identifier | 47202add-0276-4fba-84ff-ab78011bd107 | |
dc.identifier | 85016107549 | |
dc.identifier | 28330912 | |
dc.identifier | 000397884000002 | |
dc.identifier.citation | Colegrave , N & Ruxton , G D 2017 , ' Statistical model specification and power : recommendations on the use of test-qualified pooling in analysis of experimental data ' , Proceedings of the Royal Society B: Biological Sciences , vol. 284 , no. 1851 , 20161850 . https://doi.org/10.1098/rspb.2016.1850 | en |
dc.identifier.issn | 0962-8452 | |
dc.identifier.other | ORCID: /0000-0001-8943-6609/work/60427539 | |
dc.identifier.uri | https://hdl.handle.net/10023/12774 | |
dc.description.abstract | Common approach to the analysis of experimental data across much of the biological sciences is test-qualified pooling. Here non-significant terms are dropped from a statistical model, effectively pooling the variation associated with each removed term with the error term used to test hypotheses (or estimate effect sizes). This pooling is only carried out if statistical testing on the basis of applying that data to a previous more complicated model provides motivation for this model simplification; hence the pooling is test-qualified. In pooling, the researcher increases the degrees of freedom of the error term with the aim of increasing statistical power to test their hypotheses of interest. Despite this approach being widely adopted and explicitly recommended by some of the most widely cited statistical textbooks aimed at biologists, here we argue that (except in highly specialized circumstances that we can identify) the hoped-for improvement in statistical power will be small or non-existent, and there is likely to be much reduced reliability of the statistical procedures through deviation of type I error rates from nominal levels. We thus call for greatly reduced use of test-qualified pooling across experimental biology, more careful justification of any use that continues, and a different philosophy for initial selection of statistical models in the light of this change in procedure. | |
dc.format.extent | 584327 | |
dc.language.iso | eng | |
dc.relation.ispartof | Proceedings of the Royal Society B: Biological Sciences | en |
dc.subject | Experimental design | en |
dc.subject | Model simplification | en |
dc.subject | Pseudoreplication | en |
dc.subject | QH301 Biology | en |
dc.subject | Medicine(all) | en |
dc.subject | Immunology and Microbiology(all) | en |
dc.subject | Biochemistry, Genetics and Molecular Biology(all) | en |
dc.subject | Environmental Science(all) | en |
dc.subject | Agricultural and Biological Sciences(all) | en |
dc.subject | T-NDAS | en |
dc.subject.lcc | QH301 | en |
dc.title | Statistical model specification and power : recommendations on the use of test-qualified pooling in analysis of experimental data | en |
dc.type | Journal article | en |
dc.contributor.institution | University of St Andrews. School of Biology | en |
dc.contributor.institution | University of St Andrews. Centre for Biological Diversity | en |
dc.identifier.doi | https://doi.org/10.1098/rspb.2016.1850 | |
dc.description.status | Peer reviewed | en |
This item appears in the following Collection(s)
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.