Interpretation and Report Writing in Forensic Comparisons of Paint Evidence: An Inter-laboratory Exercise

Published

June 21, 2023

Author(s)

Donna J. Sirk, Andria Mehltretter, Meghan Prusinowski, Hal Arkes, David Flohr, Cedric Neumann, Scott Ryland, Tatiana Trejos

Abstract

This interlaboratory study evaluated a guide for interpreting and reporting trace evidence examinations. The online survey aimed to assess the examiners' interpretation of casework scenarios designed by a subject matter expert panel (SMEP), specifically for paint evidence. A pool of 30 scenarios was created, and 15 were assigned to each participant using multi-factor design to evaluate agreement among examiners on case sets with different conclusion ranges and difficulty levels. Exploratory data analysis and three generalized mixed-effects models were used to assess the data. From the 1267 responses received from 85 participants, approximately 93% of responses were consistent between participants and within the SMEP consensus and the next best category, while 73% agreed with the SMEP consensus that was considered the ground truth. Most disagreements were observed in worst-case scenarios created with intended higher difficulty and complex circumstances. The statistical models showed a strong positive relationship between the reported and expected conclusions, indicating that participants' findings align with the SMEP consensus. On the other hand, the exercise's difficulty level and participant's experience did not have a significant impact on the reported conclusions. However, the credible intervals for the probabilities of the different reported conclusions indicate that more experienced participants achieve greater consensus for a given exercise. The consensus reached among practitioners represents an advance in the trace community's efforts to standardize reporting of results and opinions when following systematic criteria.

Citation

Journal of Forensic Sciences

Volume

35

Issue

100513

Pub Type

Journals

Download Paper

https://doi.org/10.1016/j.forc.2023.100513

Local Download

Keywords

Evidence interpretation, Report writing, Paint examinations, Interlaboratory, Verbal scale, Organization of Scientific Area Committees (OSAC) for Forensic Science

Citation

Sirk, D. , Mehltretter, A. , Prusinowski, M. , Arkes, H. , Flohr, D. , Neumann, C. , Ryland, S. and Trejos, T. (2023), Interpretation and Report Writing in Forensic Comparisons of Paint Evidence: An Inter-laboratory Exercise, Journal of Forensic Sciences, [online], https://doi.org/10.1016/j.forc.2023.100513, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=934162 (Accessed April 28, 2024)