Accounting for structure in education assessment data using hierarchical models

dc.contributor.advisor Ulrike Genschel
dc.contributor.advisor Mark Kaiser Downey, Jillian
dc.contributor.department Statistics 2018-08-11T17:00:38.000 2020-06-30T03:08:51Z 2020-06-30T03:08:51Z Sun Jan 01 00:00:00 UTC 2017 2001-01-01 2017-01-01
dc.description.abstract <p>As the field of education continues to grow, new methods and approaches to teaching are being developed with the goal of improving students' understanding of concepts. While research exists showing positive effects for particular teaching methods in small case studies, generalizations to larger populations of students, which are needed to adequately inform policy decisions, can be difficult when using traditional inferential procedures for group comparisons that rely on randomization, replication, and control over relevant factors.</p> <p>Data collected to compare teaching methods often consists of student level responses, where students are nested within a class, which is typically the experimental unit. Further, for studies in which the scope of inference exceeds individual schools or instructors, we often have classes nested within other factors such as semesters or instructors. In the first part of this dissertation, we explore the consequences of analyzing such data without accounting for the nesting structure. We then show that a hierarchical modeling approach allows us to appropriately account for structure in this type of data. As an illustration, we demonstrate the use of a model-based approach to comparing two teaching methods by fitting a hierarchical model to data from a second course in statistics at Iowa State University.</p> <p>To fit a hierarchical model to a dataset, the nesting structure must be chosen, a priori. However, with data from an educational setting, there can be instances when the nesting structure is ambiguous. For example, should semesters be nested within instructors or vice versa? In part two of this dissertation, we develop a data-driven diagnostic using moment-based variance estimators to aid in the choice of nesting structure prior to fitting a hierarchical model. We conduct a simulation study to demonstrate the diagnostic's effectiveness and then apply the diagnostic to data from a nationally recognized standardized exam measuring statistical understanding after a first course in statistics. The results from the diagnostic and the subsequent fitted hierarchical model demonstrate the presence of a difference between the upper level grouping variable that represents the effect of interest. More broadly, this example is intended to highlight the use of hierarchical models for analyzing education data in a way that adequately accounts for variation between students that arises from nested data structures.</p>
dc.format.mimetype application/pdf
dc.identifier archive/
dc.identifier.articleid 7129
dc.identifier.contextkey 11456919
dc.identifier.s3bucket isulib-bepress-aws-west
dc.identifier.submissionpath etd/16122
dc.language.iso en
dc.source.bitstream archive/|||Fri Jan 14 20:55:28 UTC 2022
dc.subject.disciplines Statistics and Probability
dc.title Accounting for structure in education assessment data using hierarchical models
dc.type article
dc.type.genre dissertation
dspace.entity.type Publication
relation.isOrgUnitOfPublication 264904d9-9e66-4169-8e11-034e537ddbca Statistics dissertation Doctor of Philosophy
Original bundle
Now showing 1 - 1 of 1
982.62 KB
Adobe Portable Document Format