Reliability and Criterion Validity of Two Algebra Measures: Translations and Content Analysis-Multiple Choice Foegen, Anne Olson, Jeannette
dc.contributor.department Project AAIMS 2018-02-17T16:04:56.000 2020-06-30T02:14:59Z 2020-06-30T02:14:59Z 2016-04-12 2005-01-01
dc.description.abstract <p>This technical report summarizes the results of a study in which we examined the technical adequacy of two potential measures for algebra progress monitoring. Eighty-seven students (11 of whom were receiving special education services) completed two forms of a Translations measure and two forms of a Content Analysis-Multiple Choice measure during each of two data collection sessions. In addition, we gathered data on criterion variables including grades, overall grade point average, teacher ratings of student proficiency, and scores on districtadministered standardized tests, as well as a measure of algebra aptitude. We examined both test-retest and alternate form reliability for both single probe scores and aggregated scores (computed by averaging two individual scores). Criterion validity was examined by computing correlations between students’ single and aggregated scores on the probes with their scores on other indicators of proficiency in algebra. The results of this study suggest that the Translations measure is more promising than the Content Analysis-Multiple Choice measure in terms of both reliability and criterion validity. The strength of the relations obtained in this study were in the low to moderate range and were not as strong as the relations obtained with a different sample in this district using three other algebra measures (see Project AAIMS Technical Report 2 for details of the earlier study). Both measures produced acceptable distributions that were free from floor and ceiling effects. Students had roughly similar means and standard deviations on both measures. Reliability estimates for both measures fell short of expected levels for both single probes and aggregated scores. The Translations measure produced stronger correlations than the Content Analysis-Multiple Choice measure, but did not demonstrate a level of reliability that would be acceptable for instructional decision making. The majority of the criterion validity relations were in the low to moderate range. Aggregated scores produced improvements in the criterion validity estimates for the Translations measure, but not for the Content Analysis-Multiple Choice measure. The strongest relations were identified between the Translations measure and eighth graders’ performance on the district’s math achievement test, as well as between the Translations measure and all students’ performance on the algebra aptitude test. These two relations were in the moderate to strong range; relations between the Translations measure and the remaining criterion variables were in the low range.</p>
dc.description.comments <p>Project AAIMS is funded by the U.S. Department of Education, Office of Special Education Programs, Grant # H324C03006; Technical Report #6.</p>
dc.format.mimetype application/pdf
dc.identifier archive/
dc.identifier.articleid 1005
dc.identifier.contextkey 8466454
dc.identifier.s3bucket isulib-bepress-aws-west
dc.identifier.submissionpath edu_aaims_reports/2
dc.language.iso en
dc.source.bitstream archive/|||Fri Jan 14 22:06:27 UTC 2022
dc.subject.disciplines Curriculum and Instruction
dc.subject.disciplines Education
dc.subject.disciplines Higher Education
dc.subject.disciplines Science and Mathematics Education
dc.title Reliability and Criterion Validity of Two Algebra Measures: Translations and Content Analysis-Multiple Choice
dc.type article
dc.type.genre report
dspace.entity.type Publication
relation.isAuthorOfPublication 127ed746-cf23-4011-a9b2-1ca53ae7db8a
relation.isOrgUnitOfPublication 0f47f85d-c3ae-4bf5-9916-5e308105a64f
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
335.89 KB
Adobe Portable Document Format