Planning, design and logistics of a decision analysis study: The FBI/Ames study involving forensic firearms examiners

Thumbnail Image
Date
2022-02-19
Authors
Monson, Keith L.
Smith, Erich D.
Bajic, Stanley J.
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Iowa State University Digital Repository, Ames IA (United States)
Abstract
This paper describes design and logistical aspects of a decision analysis study to assess the performance of qualified firearms examiners working in accredited laboratories in the United States in terms of accuracy (error rate), repeatability, and reproducibility of decisions involving comparisons of fired bullets and cartridge cases. The purpose of the study was to validate current practice of the forensic discipline of firearms/toolmarks (F/T) examination. It elicited error rate data by counting the number of false positive and false negative conclusions. Preceded by the experimental design, decisions, and logistics described herein, testing was ultimately administered 173 qualified, practicing F/T examiners in public and private crime laboratories. The first round of testing evaluated accuracy, while two subsequent rounds evaluated repeatability and reproducibility of examiner conclusions. This project expands on previous studies by involving many F/T examiners in challenging comparisons and by executing the study in the recommended double-blind format.
Series Number
Journal Issue
Is Version Of
Versions
Series
IS-J 10730
Academic or Administrative Unit
Type
Article
Comments
This article is published as Monson, Keith L., Erich D. Smith, and Stanley J. Bajic. "Planning, design and logistics of a decision analysis study: The FBI/Ames study involving forensic firearms examiners." Forensic Science International: Synergy 4 (2022): 100221. DOI: 10.1016/j.fsisyn.2022.100221. Copyright 2022 The Authors. Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0). Posted with permission. DOE Contract Number(s): AC02-07CH11358.
Rights Statement
Copyright
Funding
DOI
Supplemental Resources
Collections