Keith L. Monson
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Keith L. Monson has a total of 45 co-authors. Here are the top co-authors by number of shared publications:
Connie L. Parks
Visiting Scientist Program, Federal Bureau of Investigation, Laboratory Division, 2501 Investigation Parkway, Quantico, VA 22135
10 shared publicationsAdam H. Richard
Laboratory Division, Federal Bureau of Investigation, 4940 Fowler Road, Redstone Arsenal, Huntsville, AL, 35898
6 shared publicationsErich D. Smith
Federal Bureau of Investigation Laboratory Quantico Virginia USA
6 shared publicationsEugene M. Peters
Federal Bureau of Investigation Laboratory Quantico Virginia USA
5 shared publicationsKelsey M. Kyllonen
FBI Laboratory, Counterterrorism and Forensic Science Research Unit Visiting Scientist Program 2501 Investigation Parkway Quantico VA 22135
4 shared publications- Terrie Simmons-Ehrhardt
Independent Consultant, Virginia, United States
3 shared publications
Latest Publications
- 14 February 2025
- Published by Wiley in Journal of Forensic Sciences
- Vol. 70 (3) , 964-979
The influence of perceived difficulty, availability of marks, and examination time on the conclusions of firearms examiners
Concurrent with studies on the accuracy, repeatability, and reproducibility of decisions based on comparisons of fired bullet and cartridge cases, we also collected the opinions of the participating examiners as to the characteristics of the specimens provided and the difficulty of making comparisons. Examiners rated the ease with which they determined every conclusion (easy, average, hard) and estimated qualitatively the amount of visual information available to them in determining a conclusion (limited, some, extensive). Comparisons deemed hard were perceived generally to have somewhat fewer markings conducive for assessment, while comparisons where the markings were limited produced a larger number of inconclusive determinations. Perceived difficulty increased with wider separation in firing order (within or between three defined segments of 700–850 total firings). The repeatability of these qualitative assessments exceeded 60% and their average reproducibility was ~50%. Examination times did not vary significantly when rendering decisions of identification, elimination, or inconclusive, although bullet identifications appear to have taken slightly longer than those for cartridge cases. Hard comparisons, where the amount of information was limited, were not treated substantially differently from any other types of comparison. No correlation was found between difficulty and number of comparisons attempted. These results tend to contradict assertions by critics that examiners are tempted to declare inconclusive decisions to save time and avoid rendering an elimination or identification conclusion, or that the results are non‐representative of casework, or that perceived difficulty affected the degree of examiner participation.
- 14 February 2025
- Published by Wiley in Journal of Forensic Sciences
- Vol. 70 (3) , 964-979
The influence of perceived difficulty, availability of marks, and examination time on the conclusions of firearms examiners
Concurrent with studies on the accuracy, repeatability, and reproducibility of decisions based on comparisons of fired bullet and cartridge cases, we also collected the opinions of the participating examiners as to the characteristics of the specimens provided and the difficulty of making comparisons. Examiners rated the ease with which they determined every conclusion (easy, average, hard) and estimated qualitatively the amount of visual information available to them in determining a conclusion (limited, some, extensive). Comparisons deemed hard were perceived generally to have somewhat fewer markings conducive for assessment, while comparisons where the markings were limited produced a larger number of inconclusive determinations. Perceived difficulty increased with wider separation in firing order (within or between three defined segments of 700–850 total firings). The repeatability of these qualitative assessments exceeded 60% and their average reproducibility was ~50%. Examination times did not vary significantly when rendering decisions of identification, elimination, or inconclusive, although bullet identifications appear to have taken slightly longer than those for cartridge cases. Hard comparisons, where the amount of information was limited, were not treated substantially differently from any other types of comparison. No correlation was found between difficulty and number of comparisons attempted. These results tend to contradict assertions by critics that examiners are tempted to declare inconclusive decisions to save time and avoid rendering an elimination or identification conclusion, or that the results are non‐representative of casework, or that perceived difficulty affected the degree of examiner participation.
- Open Access
- 2 July 2023
- Published by Wiley in Journal of Forensic Sciences
- Vol. 68 (5) , 1721-1740
Repeatability and reproducibility of comparison decisions by firearms examiners
In a comprehensive study to assess various aspects of the performance of qualified forensic firearms examiners, volunteer examiners compared both bullets and cartridge cases fired from three different types of firearms. They rendered opinions on each comparison according to the Association of Firearm & Tool Mark Examiners (AFTE) Range of Conclusions, as Identification, Inconclusive (A, B, or C), Elimination, or Unsuitable. In this part of the study, comparison sets used previously to characterize the overall accuracy of examiners were blindly resubmitted to examiners to assess the repeatability (105 examiners; 5700 comparisons of bullets and cartridge cases) and reproducibility (191 examiners of bullets, 193 of cartridge cases; 5790 comparisons) of firearms examinations. Data gathered using the prevailing AFTE Range were also recategorized into two hypothetical scoring systems. Consistently positive differences between observed agreement and expected agreement indicate that the repeatability and reproducibility of examiners exceed chance agreement. When averaged over bullets and cartridge cases, the repeatability of comparison decisions (involving all five levels of the AFTE Range) was 78.3% for known matches and 64.5% for known nonmatches. Similarly averaged reproducibility was 67.3%% for known matches and 36.5% for known nonmatches. For both repeatability and reproducibility, many of the observed disagreements were between a definitive and inconclusive category. Examiner decisions are reliable and trustworthy in the sense that identifications are unlikely when examiners are comparing non‐matching items, and eliminations are unlikely when they are comparing matching items.
- 2 July 2023
- Published by Wiley in Journal of Forensic Sciences
- Vol. 68 (5) , 1721-1740
Open AccessRepeatability and reproducibility of comparison decisions by firearms examiners
In a comprehensive study to assess various aspects of the performance of qualified forensic firearms examiners, volunteer examiners compared both bullets and cartridge cases fired from three different types of firearms. They rendered opinions on each comparison according to the Association of Firearm & Tool Mark Examiners (AFTE) Range of Conclusions, as Identification, Inconclusive (A, B, or C), Elimination, or Unsuitable. In this part of the study, comparison sets used previously to characterize the overall accuracy of examiners were blindly resubmitted to examiners to assess the repeatability (105 examiners; 5700 comparisons of bullets and cartridge cases) and reproducibility (191 examiners of bullets, 193 of cartridge cases; 5790 comparisons) of firearms examinations. Data gathered using the prevailing AFTE Range were also recategorized into two hypothetical scoring systems. Consistently positive differences between observed agreement and expected agreement indicate that the repeatability and reproducibility of examiners exceed chance agreement. When averaged over bullets and cartridge cases, the repeatability of comparison decisions (involving all five levels of the AFTE Range) was 78.3% for known matches and 64.5% for known nonmatches. Similarly averaged reproducibility was 67.3%% for known matches and 36.5% for known nonmatches. For both repeatability and reproducibility, many of the observed disagreements were between a definitive and inconclusive category. Examiner decisions are reliable and trustworthy in the sense that identifications are unlikely when examiners are comparing non‐matching items, and eliminations are unlikely when they are comparing matching items.
- Open Access
Recognizability of Demographically Altered Computerized Facial Approximations in an Automated Facial Recognition Context for Potential Application in Unidentified Persons Data Repositories
This study examined the recognizability of demographically altered facial approximations for potential utility in unidentified persons tracking systems. Five computer-generated approximations were generated for each of 26 African male participants using the following demographic parameters: (i) African male (true demographics), (ii) African female, (iii) Caucasian male, (iv) Asian male, and (v) Hispanic male. Overall, 62% of the true demographic facial approximations for the 26 African male participants examined were matched to a corresponding life photo within the top 50 images of a candidate list generated from an automated blind search of an optimally standardized gallery of 6159 photographs. When the African male participants were processed as African females, the identification rate was 50%. In contrast, less congruent identification rates were observed when the African male participants were processed as Caucasian (42%), Asian (35%), and Hispanic (27%) males. The observed results suggest that approximations generated using the opposite sex may be operationally informative if sex is unknown. The performance of approximations generated using alternative ancestry assignments, however, was less congruent with the performance of the true demographic approximation (African male) and may not yield as operationally constructive data as sex-altered approximations.
Open AccessRecognizability of Demographically Altered Computerized Facial Approximations in an Automated Facial Recognition Context for Potential Application in Unidentified Persons Data Repositories
This study examined the recognizability of demographically altered facial approximations for potential utility in unidentified persons tracking systems. Five computer-generated approximations were generated for each of 26 African male participants using the following demographic parameters: (i) African male (true demographics), (ii) African female, (iii) Caucasian male, (iv) Asian male, and (v) Hispanic male. Overall, 62% of the true demographic facial approximations for the 26 African male participants examined were matched to a corresponding life photo within the top 50 images of a candidate list generated from an automated blind search of an optimally standardized gallery of 6159 photographs. When the African male participants were processed as African females, the identification rate was 50%. In contrast, less congruent identification rates were observed when the African male participants were processed as Caucasian (42%), Asian (35%), and Hispanic (27%) males. The observed results suggest that approximations generated using the opposite sex may be operationally informative if sex is unknown. The performance of approximations generated using alternative ancestry assignments, however, was less congruent with the performance of the true demographic approximation (African male) and may not yield as operationally constructive data as sex-altered approximations.
- 21 April 2023
- Published by Wiley in Journal of Forensic Sciences
- Vol. 68 (3) , 1102-1104
Authors' response to Gutierrez et al Commentary on
- 21 April 2023
- Published by Wiley in Journal of Forensic Sciences
- Vol. 68 (3) , 1102-1104
Authors' response to Gutierrez et al Commentary on
- 21 April 2023
- Published by Wiley in Journal of Forensic Sciences
- Vol. 68 (3) , 1095-1096
Authors’ response to Scurich et al Commentary on
- 21 April 2023
- Published by Wiley in Journal of Forensic Sciences
- Vol. 68 (3) , 1095-1096
Authors’ response to Scurich et al Commentary on
- Open Access
- 1 October 2022
- Published by Wiley in Journal of Forensic Sciences
- Vol. 68 (1) , 86-100
Accuracy of comparison decisions by forensic firearms examiners
This black box study assessed the performance of forensic firearms examiners in the United States. It involved three different types of firearms and 173 volunteers who performed a total of 8640 comparisons of both bullets and cartridge cases. The overall false‐positive error rate was estimated as 0.656% and 0.933% for bullets and cartridge cases, respectively, while the rate of false negatives was estimated as 2.87% and 1.87% for bullets and cartridge cases, respectively. The majority of errors were made by a limited number of examiners. Because chi‐square tests of independence strongly suggest that error probabilities are not the same for each examiner, these are maximum‐likelihood estimates based on the beta‐binomial probability model and do not depend on an assumption of equal examiner‐specific error rates. Corresponding 95% confidence intervals are (0.305%, 1.42%) and (0.548%, 1.57%) for false positives for bullets and cartridge cases, respectively, and (1.89%, 4.26%) and (1.16%, 2.99%) for false negatives for bullets and cartridge cases, respectively. The results of this study are consistent with prior studies, despite its comprehensive design and challenging specimens.
- 1 October 2022
- Published by Wiley in Journal of Forensic Sciences
- Vol. 68 (1) , 86-100
Open AccessAccuracy of comparison decisions by forensic firearms examiners
This black box study assessed the performance of forensic firearms examiners in the United States. It involved three different types of firearms and 173 volunteers who performed a total of 8640 comparisons of both bullets and cartridge cases. The overall false‐positive error rate was estimated as 0.656% and 0.933% for bullets and cartridge cases, respectively, while the rate of false negatives was estimated as 2.87% and 1.87% for bullets and cartridge cases, respectively. The majority of errors were made by a limited number of examiners. Because chi‐square tests of independence strongly suggest that error probabilities are not the same for each examiner, these are maximum‐likelihood estimates based on the beta‐binomial probability model and do not depend on an assumption of equal examiner‐specific error rates. Corresponding 95% confidence intervals are (0.305%, 1.42%) and (0.548%, 1.57%) for false positives for bullets and cartridge cases, respectively, and (1.89%, 4.26%) and (1.16%, 2.99%) for false negatives for bullets and cartridge cases, respectively. The results of this study are consistent with prior studies, despite its comprehensive design and challenging specimens.
- Open Access
- 29 May 2022
- Published by Elsevier in Data in Brief
- Vol. 43, 108334
Cranial and facial inter-landmark distances and tissue depth dataset from computed tomography scans of 388 living persons
- 29 May 2022
- Published by Elsevier in Data in Brief
- Vol. 43, 108334
Open AccessCranial and facial inter-landmark distances and tissue depth dataset from computed tomography scans of 388 living persons
- Open Access
Postmortem and Antemortem Forensic Assessment of Pediatric Fracture Healing from Radiographs and Machine Learning Classification
A timeline of pediatric bone healing using fracture healing characteristics that can be assessed solely using radiographs would be practical for forensic casework, where the fracture event may precede death by days, months, or years. However, the dating of fractures from radiographs is difficult, imprecise, and lacks consensus, as only a few aspects of the healing process are visible on radiographs. Multiple studies in both the clinical and forensic literature have attempted to develop a usable scale to assess pediatric bone healing on radiographs using various healing characteristics. In contrast to the orthopedic definition, a fracture in forensic casework is only considered to be healed when the area around the fracture has been remodeled to the point that the fracture is difficult to detect on a radiograph or on the surface of the bone itself, a process that can take several years. We subjectively assessed visible characteristics of healing in radiograms of fractures occurring in 942 living children and adolescents. By dividing these assessments into learning and test (validation) sets, the accuracy of a newly proposed fracture healing scale was compared to a previous study. Two machine learning models were used to test predictions of the new scale. All three models produced similar estimates with substantial imprecision. Results corroborate the Malone model with an independent dataset and support the efficacy of using less complex models to estimate fracture age in children.
Open AccessPostmortem and Antemortem Forensic Assessment of Pediatric Fracture Healing from Radiographs and Machine Learning Classification
A timeline of pediatric bone healing using fracture healing characteristics that can be assessed solely using radiographs would be practical for forensic casework, where the fracture event may precede death by days, months, or years. However, the dating of fractures from radiographs is difficult, imprecise, and lacks consensus, as only a few aspects of the healing process are visible on radiographs. Multiple studies in both the clinical and forensic literature have attempted to develop a usable scale to assess pediatric bone healing on radiographs using various healing characteristics. In contrast to the orthopedic definition, a fracture in forensic casework is only considered to be healed when the area around the fracture has been remodeled to the point that the fracture is difficult to detect on a radiograph or on the surface of the bone itself, a process that can take several years. We subjectively assessed visible characteristics of healing in radiograms of fractures occurring in 942 living children and adolescents. By dividing these assessments into learning and test (validation) sets, the accuracy of a newly proposed fracture healing scale was compared to a previous study. Two machine learning models were used to test predictions of the new scale. All three models produced similar estimates with substantial imprecision. Results corroborate the Malone model with an independent dataset and support the efficacy of using less complex models to estimate fracture age in children.
- Open Access
- 19 February 2022
- Published by Elsevier in Forensic Science International: Synergy
- Vol. 4, 100221
Planning, design and logistics of a decision analysis study: The FBI/Ames study involving forensic firearms examiners
- 19 February 2022
- Published by Elsevier in Forensic Science International: Synergy
- Vol. 4, 100221
Open AccessPlanning, design and logistics of a decision analysis study: The FBI/Ames study involving forensic firearms examiners