Proficiency testing of fingerprint examiners with Bayesian Item Response Theory

Date
2018-06-01
Authors
Luby, Amanda
Kadane, Joseph
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Altmetrics
Authors
Research Projects
Organizational Units
Journal Issue
Series
Department
Center for Statistics and Applications in Forensic Evidence
Abstract

In recent years, the forensic community has pushed to increase the scientific basis of forensic evidence, which has included proficiency testing for fingerprint analysts. We used proficiency testing data collected by Collaborative Testing Services in which 431 fingerprint analysts were asked to identify the source of latent prints. The data were analysed using a Rasch model with a Bayesian estimation approach. Although these data provide valuable information about the relative proficiency of the examiners and the relative difficulty of the questions, it does not necessarily extrapolate onto general performance of examiners or difficulty in casework, which we show through sensitivity analysis and simulation. We show that a Bayesian Item Response Theory (IRT) analysis provides a deeper understanding of analysts’ proficiency and question difficulty than other forms of analysis. A large-scale adoption of IRT in this area would provide both more precise estimates of proficiency and quantitative evidence for the relative difficulty of different questions.

Comments

This is a manuscript of an article published as Luby, Amanda S., and Joseph B. Kadane. "Proficiency testing of fingerprint examiners with Bayesian Item Response Theory." Law, Probability and Risk 17, no. 2 (2018): 111-121. Posted with permission of CSAFE.

Description
Keywords
Citation
DOI
Collections