GHEP-ISFG collaborative simulated exercise for DVI/MPI

Lessons learned about large-scale profile database comparisons

Carlos M. Vullo, Magdalena Romero, Laura Catelli, Mustafa Šakić, Victor G. Saragoni, María Jose Jimenez Pleguezuelos, Carola Romanini, Maria João Anjos Porto, Jorge Puente Prieto, Alicia Bofarull Castro, Alexis Hernandez, María José Farfán, Victoria Prieto, David Alvarez, Gustavo Penacino, Santiago Zabalza, Alejandro Hernández Bolaños, Irati Miguel Manterola, Lourdes Prieto, Thomas John Parsons

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

The GHEP-ISFG Working Group has recognized the importance of assisting DNA laboratories to gain expertise in handling DVI or missing persons identification (MPI) projects which involve the need for large-scale genetic profile comparisons. Eleven laboratories participated in a DNA matching exercise to identify victims from a hypothetical conflict with 193 missing persons. The post mortem database was comprised of 87 skeletal remain profiles from a secondary mass grave displaying a minimal number of 58 individuals with evidence of commingling. The reference database was represented by 286 family reference profiles with diverse pedigrees. The goal of the exercise was to correctly discover re-associations and family matches. The results of direct matching for commingled remains re-associations were correct and fully concordant among all laboratories. However, the kinship analysis for missing persons identifications showed variable results among the participants. There was a group of laboratories with correct, concordant results but nearly half of the others showed discrepant results exhibiting likelihood ratio differences of several degrees of magnitude in some cases. Three main errors were detected: (a) some laboratories did not use the complete reference family genetic data to report the match with the remains, (b) the identity and/or non-identity hypotheses were sometimes wrongly expressed in the likelihood ratio calculations, and (c) many laboratories did not properly evaluate the prior odds for the event. The results suggest that large-scale profile comparisons for DVI or MPI is a challenge for forensic genetics laboratories and the statistical treatment of DNA matching and the Bayesian framework should be better standardized among laboratories.

Original languageEnglish (US)
Pages (from-to)45-53
Number of pages9
JournalForensic Science International: Genetics
Volume21
DOIs
StatePublished - Mar 1 2016

Fingerprint

Databases
DNA
Forensic Genetics
Pedigree

All Science Journal Classification (ASJC) codes

  • Pathology and Forensic Medicine
  • Genetics

Cite this

Vullo, C. M., Romero, M., Catelli, L., Šakić, M., Saragoni, V. G., Jimenez Pleguezuelos, M. J., ... Parsons, T. J. (2016). GHEP-ISFG collaborative simulated exercise for DVI/MPI: Lessons learned about large-scale profile database comparisons. Forensic Science International: Genetics, 21, 45-53. https://doi.org/10.1016/j.fsigen.2015.11.004
Vullo, Carlos M. ; Romero, Magdalena ; Catelli, Laura ; Šakić, Mustafa ; Saragoni, Victor G. ; Jimenez Pleguezuelos, María Jose ; Romanini, Carola ; Anjos Porto, Maria João ; Puente Prieto, Jorge ; Bofarull Castro, Alicia ; Hernandez, Alexis ; Farfán, María José ; Prieto, Victoria ; Alvarez, David ; Penacino, Gustavo ; Zabalza, Santiago ; Hernández Bolaños, Alejandro ; Miguel Manterola, Irati ; Prieto, Lourdes ; Parsons, Thomas John. / GHEP-ISFG collaborative simulated exercise for DVI/MPI : Lessons learned about large-scale profile database comparisons. In: Forensic Science International: Genetics. 2016 ; Vol. 21. pp. 45-53.
@article{714b03e30be1437ab2a23d0f50d4e19a,
title = "GHEP-ISFG collaborative simulated exercise for DVI/MPI: Lessons learned about large-scale profile database comparisons",
abstract = "The GHEP-ISFG Working Group has recognized the importance of assisting DNA laboratories to gain expertise in handling DVI or missing persons identification (MPI) projects which involve the need for large-scale genetic profile comparisons. Eleven laboratories participated in a DNA matching exercise to identify victims from a hypothetical conflict with 193 missing persons. The post mortem database was comprised of 87 skeletal remain profiles from a secondary mass grave displaying a minimal number of 58 individuals with evidence of commingling. The reference database was represented by 286 family reference profiles with diverse pedigrees. The goal of the exercise was to correctly discover re-associations and family matches. The results of direct matching for commingled remains re-associations were correct and fully concordant among all laboratories. However, the kinship analysis for missing persons identifications showed variable results among the participants. There was a group of laboratories with correct, concordant results but nearly half of the others showed discrepant results exhibiting likelihood ratio differences of several degrees of magnitude in some cases. Three main errors were detected: (a) some laboratories did not use the complete reference family genetic data to report the match with the remains, (b) the identity and/or non-identity hypotheses were sometimes wrongly expressed in the likelihood ratio calculations, and (c) many laboratories did not properly evaluate the prior odds for the event. The results suggest that large-scale profile comparisons for DVI or MPI is a challenge for forensic genetics laboratories and the statistical treatment of DNA matching and the Bayesian framework should be better standardized among laboratories.",
author = "Vullo, {Carlos M.} and Magdalena Romero and Laura Catelli and Mustafa Šakić and Saragoni, {Victor G.} and {Jimenez Pleguezuelos}, {Mar{\'i}a Jose} and Carola Romanini and {Anjos Porto}, {Maria Jo{\~a}o} and {Puente Prieto}, Jorge and {Bofarull Castro}, Alicia and Alexis Hernandez and Farf{\'a}n, {Mar{\'i}a Jos{\'e}} and Victoria Prieto and David Alvarez and Gustavo Penacino and Santiago Zabalza and {Hern{\'a}ndez Bola{\~n}os}, Alejandro and {Miguel Manterola}, Irati and Lourdes Prieto and Parsons, {Thomas John}",
year = "2016",
month = "3",
day = "1",
doi = "10.1016/j.fsigen.2015.11.004",
language = "English (US)",
volume = "21",
pages = "45--53",
journal = "Forensic Science International: Genetics",
issn = "1872-4973",
publisher = "Elsevier Ireland Ltd",

}

Vullo, CM, Romero, M, Catelli, L, Šakić, M, Saragoni, VG, Jimenez Pleguezuelos, MJ, Romanini, C, Anjos Porto, MJ, Puente Prieto, J, Bofarull Castro, A, Hernandez, A, Farfán, MJ, Prieto, V, Alvarez, D, Penacino, G, Zabalza, S, Hernández Bolaños, A, Miguel Manterola, I, Prieto, L & Parsons, TJ 2016, 'GHEP-ISFG collaborative simulated exercise for DVI/MPI: Lessons learned about large-scale profile database comparisons', Forensic Science International: Genetics, vol. 21, pp. 45-53. https://doi.org/10.1016/j.fsigen.2015.11.004

GHEP-ISFG collaborative simulated exercise for DVI/MPI : Lessons learned about large-scale profile database comparisons. / Vullo, Carlos M.; Romero, Magdalena; Catelli, Laura; Šakić, Mustafa; Saragoni, Victor G.; Jimenez Pleguezuelos, María Jose; Romanini, Carola; Anjos Porto, Maria João; Puente Prieto, Jorge; Bofarull Castro, Alicia; Hernandez, Alexis; Farfán, María José; Prieto, Victoria; Alvarez, David; Penacino, Gustavo; Zabalza, Santiago; Hernández Bolaños, Alejandro; Miguel Manterola, Irati; Prieto, Lourdes; Parsons, Thomas John.

In: Forensic Science International: Genetics, Vol. 21, 01.03.2016, p. 45-53.

Research output: Contribution to journalArticle

TY - JOUR

T1 - GHEP-ISFG collaborative simulated exercise for DVI/MPI

T2 - Lessons learned about large-scale profile database comparisons

AU - Vullo, Carlos M.

AU - Romero, Magdalena

AU - Catelli, Laura

AU - Šakić, Mustafa

AU - Saragoni, Victor G.

AU - Jimenez Pleguezuelos, María Jose

AU - Romanini, Carola

AU - Anjos Porto, Maria João

AU - Puente Prieto, Jorge

AU - Bofarull Castro, Alicia

AU - Hernandez, Alexis

AU - Farfán, María José

AU - Prieto, Victoria

AU - Alvarez, David

AU - Penacino, Gustavo

AU - Zabalza, Santiago

AU - Hernández Bolaños, Alejandro

AU - Miguel Manterola, Irati

AU - Prieto, Lourdes

AU - Parsons, Thomas John

PY - 2016/3/1

Y1 - 2016/3/1

N2 - The GHEP-ISFG Working Group has recognized the importance of assisting DNA laboratories to gain expertise in handling DVI or missing persons identification (MPI) projects which involve the need for large-scale genetic profile comparisons. Eleven laboratories participated in a DNA matching exercise to identify victims from a hypothetical conflict with 193 missing persons. The post mortem database was comprised of 87 skeletal remain profiles from a secondary mass grave displaying a minimal number of 58 individuals with evidence of commingling. The reference database was represented by 286 family reference profiles with diverse pedigrees. The goal of the exercise was to correctly discover re-associations and family matches. The results of direct matching for commingled remains re-associations were correct and fully concordant among all laboratories. However, the kinship analysis for missing persons identifications showed variable results among the participants. There was a group of laboratories with correct, concordant results but nearly half of the others showed discrepant results exhibiting likelihood ratio differences of several degrees of magnitude in some cases. Three main errors were detected: (a) some laboratories did not use the complete reference family genetic data to report the match with the remains, (b) the identity and/or non-identity hypotheses were sometimes wrongly expressed in the likelihood ratio calculations, and (c) many laboratories did not properly evaluate the prior odds for the event. The results suggest that large-scale profile comparisons for DVI or MPI is a challenge for forensic genetics laboratories and the statistical treatment of DNA matching and the Bayesian framework should be better standardized among laboratories.

AB - The GHEP-ISFG Working Group has recognized the importance of assisting DNA laboratories to gain expertise in handling DVI or missing persons identification (MPI) projects which involve the need for large-scale genetic profile comparisons. Eleven laboratories participated in a DNA matching exercise to identify victims from a hypothetical conflict with 193 missing persons. The post mortem database was comprised of 87 skeletal remain profiles from a secondary mass grave displaying a minimal number of 58 individuals with evidence of commingling. The reference database was represented by 286 family reference profiles with diverse pedigrees. The goal of the exercise was to correctly discover re-associations and family matches. The results of direct matching for commingled remains re-associations were correct and fully concordant among all laboratories. However, the kinship analysis for missing persons identifications showed variable results among the participants. There was a group of laboratories with correct, concordant results but nearly half of the others showed discrepant results exhibiting likelihood ratio differences of several degrees of magnitude in some cases. Three main errors were detected: (a) some laboratories did not use the complete reference family genetic data to report the match with the remains, (b) the identity and/or non-identity hypotheses were sometimes wrongly expressed in the likelihood ratio calculations, and (c) many laboratories did not properly evaluate the prior odds for the event. The results suggest that large-scale profile comparisons for DVI or MPI is a challenge for forensic genetics laboratories and the statistical treatment of DNA matching and the Bayesian framework should be better standardized among laboratories.

UR - http://www.scopus.com/inward/record.url?scp=84950349532&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84950349532&partnerID=8YFLogxK

U2 - 10.1016/j.fsigen.2015.11.004

DO - 10.1016/j.fsigen.2015.11.004

M3 - Article

VL - 21

SP - 45

EP - 53

JO - Forensic Science International: Genetics

JF - Forensic Science International: Genetics

SN - 1872-4973

ER -