The Problem of Too Many Statistical Tests: Subgroup Analyses in a Study Comparing the Effectiveness of Online and Live Lectures

dc.creator	David M. Lane
dc.date	2013-01-01T00:00:00Z
dc.date.accessioned	2015-07-20T22:26:44Z
dc.date.available	2015-07-20T22:26:44Z
dc.identifier	1936-4660
dc.identifier	https://doaj.org/article/b1b87030e0c44625816db1a14195e6cc
dc.identifier.uri	http://evidence.thinkportal.org/handle/123456789/21668
dc.description	The more statistical analyses performed in the analysis of research data, the more likely it is that one or more of the conclusions will be in error. Multiple statistical analyses can occur when the sample contains several subgroups and the researchers perform separate analyses for each subgroup. For example, separate analyses may be done for different ethnic groups, different levels of education, and/or for both genders. Media reports of research frequently omit information on the number of subgroup analyses performed thus leaving the reader with insufficient information to assess the validity of the conclusions. This article discusses the problems with a media report on research that was analyzed by conducting many subgroup analyses. The article concludes that the quantitatively literate reader should be skeptical of articles that report subgroup analyses without reporting the number of analyses that were done.
dc.language	English
dc.publisher	University of South Florida Libraries
dc.relation	http://dx.doi.org/10.5038/1936-4660.6.1.7
dc.relation	https://doaj.org/toc/1936-4660
dc.rights	CC BY-NC
dc.source	Numeracy, Vol 6, Iss 1, p 7 (2013)
dc.subject	multiple comparisons
dc.subject	quantitative literacy
dc.subject	online learning
dc.subject	subgroup analyses
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	DOAJ:Education
dc.subject	DOAJ:Social Sciences
dc.subject	Mathematics
dc.subject	QA1-939
dc.subject	Science
dc.subject	Q
dc.subject	DOAJ:Mathematics
dc.subject	DOAJ:Mathematics and Statistics
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	DOAJ:Education
dc.subject	DOAJ:Social Sciences
dc.subject	Mathematics
dc.subject	QA1-939
dc.subject	Science
dc.subject	Q
dc.subject	DOAJ:Mathematics
dc.subject	DOAJ:Mathematics and Statistics
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	Mathematics
dc.subject	QA1-939
dc.subject	Science
dc.subject	Q
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	Mathematics
dc.subject	QA1-939
dc.subject	Science
dc.subject	Q
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	Mathematics
dc.subject	QA1-939
dc.subject	Science
dc.subject	Q
dc.title	The Problem of Too Many Statistical Tests: Subgroup Analyses in a Study Comparing the Effectiveness of Online and Live Lectures
dc.type	article