Investigating Factors That Influence Item Performance on ACS Exams

Thumbnail Image
Supplemental Files
Date
2012-01-01
Authors
Schroeder, Jacob
Murphy, Kristen
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract

General chemistry tests from the Examinations Institute of the Division of Chemical Education of the American Chemical Society have been analyzed to identify factors that may influence how individual test items perform. In this paper, issues of item order (position within a set of items that comprise a test) and answer order (position of correct answer relative to incorrect distractors) are discussed. Answer order is identified as potentially important, particularly for conceptually based items. When the correct answer appears earlier among the answer choices, there is some greater propensity for student performance to be better. Item-order effects are also possible, particularly when students encounter several challenging items consecutively. Performance on the next item may be lower than expected, possibly because of cognitive-load effects.

Series Number
Journal Issue
Is Version Of
Versions
Series
Academic or Administrative Unit
Type
article
Comments

Reprinted (adapted) with permission from J. Chem. Educ., 2012, 89 (3), pp 346–350. Copyright 2012 American Chemical Society.

Rights Statement
Copyright
Sun Jan 01 00:00:00 UTC 2012
Funding
DOI
Supplemental Resources
Collections