Evaluative misalignment of 10th-grade student and teacher criteria for essay quality: An automated textual analysis

dc.creator	Laura K. Varner, Rod D. Roscoe & Danielle S. McNamara
dc.date	2013-06-01T00:00:00Z
dc.date.accessioned	2015-07-20T22:28:40Z
dc.date.available	2015-07-20T22:28:40Z
dc.identifier	2030-1006
dc.identifier	https://doaj.org/article/af9dd79b7c2f48a08e7ff2993141cc28
dc.identifier.uri	http://evidence.thinkportal.org/handle/123456789/22019
dc.description	Writing is a necessary skill for success in the classroom and the workplace; yet, many students are failing to develop sufficient skills in this area. One potential problem may stem from a misalignment between students' and teachers' criteria for quality writing. According to the evaluative misalignment hypothesis, students assess their own writing using a different set of criteria from their teachers. In this study, the authors utilize automated textual analyses to examine potential misalignments between students' and teachers' evaluation criteria for writing quality. Specifically, the computational tools Coh-Metrix and Linguistic Inquiry and Word Count (LIWC) are used to examine the relationship between linguistic features and student and teacher ratings of students' prompt-based essays. The study included 126 students who wrote timed, SAT-style essays and assessed their own writing on a scale of 1-6. Teachers also evaluated the essays using the SAT rubric on a scale of 1-6. The results yielded empirical evidence for student-teacher misalignment and advanced our understanding of the nature of students' misalignments. Specifically, teachers were attuned to the linguistic features of the essays at both surface and deep levels of text, whereas students' ratings were related to fewer overall textual features and most closely associated with surface-level features.
dc.language	English
dc.publisher	University of Antwerp
dc.relation	http://jowr.org/Ccount/click.php?id=65
dc.relation	https://doaj.org/toc/2030-1006
dc.rights	CC BY-NC-ND
dc.source	Journal of Writing Research , Vol 5, Iss 1, Pp 35-59 (2013)
dc.subject	writing assessment
dc.subject	teacher essay evaluation
dc.subject	self-assessment
dc.subject	computational linguistics
dc.subject	textual analysis
dc.subject	Philology. Linguistics
dc.subject	P1-1091
dc.subject	Language and Literature
dc.subject	P
dc.subject	DOAJ:Linguistics
dc.subject	DOAJ:Languages and Literatures
dc.subject	Psychology
dc.subject	BF1-990
dc.subject	Philosophy. Psychology. Religion
dc.subject	B
dc.subject	DOAJ:Psychology
dc.subject	DOAJ:Social Sciences
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	DOAJ:Education
dc.subject	DOAJ:Social Sciences
dc.subject	Philology. Linguistics
dc.subject	P1-1091
dc.subject	Language and Literature
dc.subject	P
dc.subject	DOAJ:Linguistics
dc.subject	DOAJ:Languages and Literatures
dc.subject	Psychology
dc.subject	BF1-990
dc.subject	Philosophy. Psychology. Religion
dc.subject	B
dc.subject	DOAJ:Psychology
dc.subject	DOAJ:Social Sciences
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	DOAJ:Education
dc.subject	DOAJ:Social Sciences
dc.subject	Philology. Linguistics
dc.subject	P1-1091
dc.subject	Language and Literature
dc.subject	P
dc.subject	Psychology
dc.subject	BF1-990
dc.subject	Philosophy. Psychology. Religion
dc.subject	B
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	Philology. Linguistics
dc.subject	P1-1091
dc.subject	Language and Literature
dc.subject	P
dc.subject	Psychology
dc.subject	BF1-990
dc.subject	Philosophy. Psychology. Religion
dc.subject	B
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	Philology. Linguistics
dc.subject	P1-1091
dc.subject	Language and Literature
dc.subject	P
dc.subject	Psychology
dc.subject	BF1-990
dc.subject	Philosophy. Psychology. Religion
dc.subject	B
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.title	Evaluative misalignment of 10th-grade student and teacher criteria for essay quality: An automated textual analysis
dc.type	article