Rasch scaling procedures for informing development of a valid Fetal Surveillance Education Program multiple-choice assessment

dc.creator	Beaves Mark
dc.creator	Griffin Patrick
dc.creator	Zoanetti Nathan
dc.creator	Wallace Euan M
dc.date	2009-04-01T00:00:00Z
dc.date.accessioned	2015-08-12T11:22:53Z
dc.date.available	2015-08-12T11:22:53Z
dc.identifier	10.1186/1472-6920-9-20
dc.identifier	1472-6920
dc.identifier	https://doaj.org/article/8bcdf40d46a94c66b740818c21bbb1d3
dc.identifier.uri	http://evidence.thinkportal.org/handle/123456789/29507
dc.description	<p>Abstract</p> <p>Background</p> <p>It is widely recognised that deficiencies in fetal surveillance practice continue to contribute significantly to the burden of adverse outcomes. This has prompted the development of evidence-based clinical practice guidelines by the Royal Australian and New Zealand College of Obstetricians and Gynaecologists and an associated Fetal Surveillance Education Program to deliver the associated learning. This article describes initial steps in the validation of a corresponding multiple-choice assessment of the relevant educational outcomes through a combination of item response modelling and expert judgement.</p> <p>Methods</p> <p>The Rasch item response model was employed for item and test analysis and to empirically derive the substantive interpretation of the assessment variable. This interpretation was then compared to the hierarchy of competencies specified a priori by a team of eight subject-matter experts. Classical Test Theory analyses were also conducted.</p> <p>Results</p> <p>A high level of agreement between the hypothesised and derived variable provided evidence of construct validity. Item and test indices from Rasch analysis and Classical Test Theory analysis suggested that the current test form was of moderate quality. However, the analyses made clear the required steps for establishing a valid assessment of sufficient psychometric quality. These steps included: increasing the number of items from 40 to 50 in the first instance, reviewing ineffective items, targeting new items to specific content and difficulty gaps, and formalising the assessment blueprint in light of empirical information relating item structure to item difficulty.</p> <p>Conclusion</p> <p>The application of the Rasch model for criterion-referenced assessment validation with an expert stakeholder group is herein described. Recommendations for subsequent item and test construction are also outlined in this article.</p>
dc.language	English
dc.publisher	BioMed Central
dc.relation	http://www.biomedcentral.com/1472-6920/9/20
dc.relation	https://doaj.org/toc/1472-6920
dc.rights	CC BY
dc.source	BMC Medical Education, Vol 9, Iss 1, p 20 (2009)
dc.subject	Medicine (General)
dc.subject	R5-920
dc.subject	Medicine
dc.subject	R
dc.subject	DOAJ:Medicine (General)
dc.subject	DOAJ:Health Sciences
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	DOAJ:Education
dc.subject	DOAJ:Social Sciences
dc.subject	Medicine (General)
dc.subject	R5-920
dc.subject	Medicine
dc.subject	R
dc.subject	DOAJ:Medicine (General)
dc.subject	DOAJ:Health Sciences
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	DOAJ:Education
dc.subject	DOAJ:Social Sciences
dc.subject	Medicine (General)
dc.subject	R5-920
dc.subject	Medicine
dc.subject	R
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	Medicine (General)
dc.subject	R5-920
dc.subject	Medicine
dc.subject	R
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.subject	Medicine (General)
dc.subject	R5-920
dc.subject	Medicine
dc.subject	R
dc.subject	Special aspects of education
dc.subject	LC8-6691
dc.subject	Education
dc.subject	L
dc.title	Rasch scaling procedures for informing development of a valid Fetal Surveillance Education Program multiple-choice assessment
dc.type	article