Skip to main content
Top

26-03-2024 | Original Article

Prioritizing a high posterior probability threshold leading to low error rate over high classification accuracy: the validity of MorphoPASSE software for cranial morphological sex estimation in a contemporary population

Authors: Anežka Pilmann Kotěrová, Frédéric Santos, Šárka Bejdová, Rebeka Rmoutilová, MennattAllah Hassan Attia, Ahmed Habiba, Jana Velemínská, Jaroslav Brůžek

Published in: International Journal of Legal Medicine

Login to get access

Abstract

An increasing number of software tools can be used in forensic anthropology to estimate a biological profile, but further studies in other populations are required for more robust validation. The present study aimed to evaluate the validity of MorphoPASSE software for sex estimation from sexually dimorphic cranial traits recorded on 3D CT models (n = 180) from three populations samples (Czech, French, and Egyptian). Two independent observers performed scoring of 4 cranial traits (2 of them bilateral) in each population sample of 30 males and 30 females. The accuracy of sex estimation using traditional posterior probability threshold (pp = 0.5) ranged from 85.6% to 88.3% and overall classification error from 14.4% to 11.7% for both observers, and corresponds to the previously published values of the method. The MorphoPASSE method is also affected by the subjectivity of the observers, as both observers show agreement in sex assignment in 83.9% of cases, regardless of the accuracy of the estimates. Applying a higher posterior probability threshold (pp 0.95) provided classification accuracy of 97.9% and 93.3% of individuals (for observer A and B respectively), minimizing the risk of error to 2.1% and 6.7%, respectively. However, sex estimation can only be applied to 54% and 66% of individuals, respectively. Our results demonstrate the validity of the MorphoPASSE software for cranial sex estimation outside the reference population. However, the achieved classification success is accompanied by a high risk of errors, the reduction of which is only possible by increasing the posterior probability threshold.
Literature
1.
go back to reference Acsádi G, Nemeskéri J (1970) History of human life span and mortality. Akademiai Kiado, Budapest Acsádi G, Nemeskéri J (1970) History of human life span and mortality. Akademiai Kiado, Budapest
5.
go back to reference Attia MH, Kholief MA, Zaghloul NM et al (2022b) Efficiency of the Adjusted Binary Classification (ABC) approach in osteometric sex estimation: a comparative study of different linear machine learning algorithms and training sample sizes. Biology (Basel) 11:917PubMed Attia MH, Kholief MA, Zaghloul NM et al (2022b) Efficiency of the Adjusted Binary Classification (ABC) approach in osteometric sex estimation: a comparative study of different linear machine learning algorithms and training sample sizes. Biology (Basel) 11:917PubMed
9.
go back to reference Baumgarten SE, Kenyon-Flatt B (2020) Metric methods for estimating sex utilizing the pelvis. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 171–184CrossRef Baumgarten SE, Kenyon-Flatt B (2020) Metric methods for estimating sex utilizing the pelvis. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 171–184CrossRef
10.
go back to reference Bertsatos A, Chovalopoulou ME, Brůžek J, Bejdová Š (2020) Advanced procedures for skull sex estimation using sexually dimorphic morphometric features. Int J Legal Med 134:1927–1937CrossRefPubMed Bertsatos A, Chovalopoulou ME, Brůžek J, Bejdová Š (2020) Advanced procedures for skull sex estimation using sexually dimorphic morphometric features. Int J Legal Med 134:1927–1937CrossRefPubMed
11.
go back to reference Bertsatos A, Christaki A, Chovalopoulou ME (2019) Testing the reliability of 3D-ID software in sex and ancestry estimation with a modern Greek sample. Forensic Sci Int 297:132–137CrossRefPubMed Bertsatos A, Christaki A, Chovalopoulou ME (2019) Testing the reliability of 3D-ID software in sex and ancestry estimation with a modern Greek sample. Forensic Sci Int 297:132–137CrossRefPubMed
12.
go back to reference Boucherie A (2023) Analyse du dimorphisme sexuel de variables métriques de la base du crâne: intérêts archéo-anthropologiques et forensiques. Dissertation. Université Libre de Bruxelles Boucherie A (2023) Analyse du dimorphisme sexuel de variables métriques de la base du crâne: intérêts archéo-anthropologiques et forensiques. Dissertation. Université Libre de Bruxelles
13.
go back to reference Boyd C, Boyd D (2018) Forensic anthropology: theoretical framework and scientific basis. John Wiley & Sons, HobokenCrossRef Boyd C, Boyd D (2018) Forensic anthropology: theoretical framework and scientific basis. John Wiley & Sons, HobokenCrossRef
14.
go back to reference Brennan EJ (2023) Differential adult mortality risk from late medieval to early modern Berlin: health consequences at the intersection of urban growth and climate change. Am J Biol Anthropol 180:21 Brennan EJ (2023) Differential adult mortality risk from late medieval to early modern Berlin: health consequences at the intersection of urban growth and climate change. Am J Biol Anthropol 180:21
15.
go back to reference Brůžek J, Murail P (2006) Methodology and reliability of sex determination from the skeleton. In: Schmitt A, Cunha E, Pinheiro J (eds) Forensic anthropology and medicine: complementary sciences from recovery to cause of death. Humana Press Inc., Totowa, pp 225–242CrossRef Brůžek J, Murail P (2006) Methodology and reliability of sex determination from the skeleton. In: Schmitt A, Cunha E, Pinheiro J (eds) Forensic anthropology and medicine: complementary sciences from recovery to cause of death. Humana Press Inc., Totowa, pp 225–242CrossRef
17.
go back to reference Buikstra JE, Ubelaker DH (1994) Standards for data collection from human skeletal remains : proceedings of a seminar at the Field Museum of Natural History, organized by Jonathan Haas. Archeological Survey Buikstra JE, Ubelaker DH (1994) Standards for data collection from human skeletal remains : proceedings of a seminar at the Field Museum of Natural History, organized by Jonathan Haas. Archeological Survey
18.
go back to reference Byrnes JF, Torres SEM, Johnson LJ et al (2023) New tricks, old bones, reassessing assigned sex at birth estimations of the Erie County Poorhouse cemetery using MorphoPASSE. Am J Biol Anthropol 180:24 Byrnes JF, Torres SEM, Johnson LJ et al (2023) New tricks, old bones, reassessing assigned sex at birth estimations of the Erie County Poorhouse cemetery using MorphoPASSE. Am J Biol Anthropol 180:24
19.
go back to reference Cappella A, Bertoglio B, Di Maso M et al (2022) Sexual dimorphism of cranial morphological traits in an italian sample: a population-specific logistic regression model for predicting sex. Biology (Basel) 11:1202PubMed Cappella A, Bertoglio B, Di Maso M et al (2022) Sexual dimorphism of cranial morphological traits in an italian sample: a population-specific logistic regression model for predicting sex. Biology (Basel) 11:1202PubMed
20.
go back to reference Cohen J (1968) Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull 70:213–220CrossRefPubMed Cohen J (1968) Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull 70:213–220CrossRefPubMed
21.
go back to reference Daubert v. Merrell Dow Pharmaceuticals (1993) Daubert v. Merrell Dow Pharmaceuticals Daubert v. Merrell Dow Pharmaceuticals (1993) Daubert v. Merrell Dow Pharmaceuticals
23.
go back to reference Dirkmaat, Cabo LL (2012) Forensic anthropology: embracing the new paradigm. In: Dirkmaat DC (ed) A companion to forensic anthropology. Wiley, Ltd, pp 3–40 Dirkmaat, Cabo LL (2012) Forensic anthropology: embracing the new paradigm. In: Dirkmaat DC (ed) A companion to forensic anthropology. Wiley, Ltd, pp 3–40
25.
go back to reference Ferembach D, Schwidetzky I, Stloukal M (1980) Recommendations for age and sex diagnoses of skeletons. J Hum Evol 9:517–549CrossRef Ferembach D, Schwidetzky I, Stloukal M (1980) Recommendations for age and sex diagnoses of skeletons. J Hum Evol 9:517–549CrossRef
27.
go back to reference Galeta P, Brůžek J (2020) Sex estimation using continuous variables: problems and principles of sex classification in the zone of uncertainty. In: Obertová Z, Stewart A, Cattaneo C (eds) Statistics and probability in forensic anthropology. Academic Press, pp 155–182CrossRef Galeta P, Brůžek J (2020) Sex estimation using continuous variables: problems and principles of sex classification in the zone of uncertainty. In: Obertová Z, Stewart A, Cattaneo C (eds) Statistics and probability in forensic anthropology. Academic Press, pp 155–182CrossRef
28.
go back to reference Garvin (2020) Adult sex estimation from cranial morphological traits. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 95–112CrossRef Garvin (2020) Adult sex estimation from cranial morphological traits. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 95–112CrossRef
29.
go back to reference Garvin HM, Uhl N, Passalacqua NV et al (2012) Developments in forensic anthropology: age at- death estimation. In: Dirkmaat DC (ed) A companion to forensic anthropology, first. Wiley-Blackwell, London, pp 202–223CrossRef Garvin HM, Uhl N, Passalacqua NV et al (2012) Developments in forensic anthropology: age at- death estimation. In: Dirkmaat DC (ed) A companion to forensic anthropology, first. Wiley-Blackwell, London, pp 202–223CrossRef
30.
go back to reference Garvin, Klales A (2020) Adult skeletal sex estimation and global standardization. In: Parra R, Zapico S, Ubelaker D (eds) Forensic science and humanitarian action: interacting with the dead and the living. Wiley, Ltd, pp 109–209 Garvin, Klales A (2020) Adult skeletal sex estimation and global standardization. In: Parra R, Zapico S, Ubelaker D (eds) Forensic science and humanitarian action: interacting with the dead and the living. Wiley, Ltd, pp 109–209
31.
go back to reference Garvin, Sholts S, Mosca L (2014) Sexual dimorphism in human cranial trait scores: effects of population, age, and body size. Am J Phys Anthropol 154:259–269CrossRefPubMed Garvin, Sholts S, Mosca L (2014) Sexual dimorphism in human cranial trait scores: effects of population, age, and body size. Am J Phys Anthropol 154:259–269CrossRefPubMed
33.
go back to reference Grivas CR, Komar DA (2008) Kumho, Daubert, and the nature of scientific inquiry: Implications for forensic anthropology. J Forensic Sci 53:771–776CrossRefPubMed Grivas CR, Komar DA (2008) Kumho, Daubert, and the nature of scientific inquiry: Implications for forensic anthropology. J Forensic Sci 53:771–776CrossRefPubMed
34.
go back to reference Guyomarc’h, Brůžek J (2011) Accuracy and reliability in sex determination from skulls: a comparison of Fordisc® 3.0 and the discriminant function analysis. Forensic Sci Int 208:180-e1CrossRef Guyomarc’h, Brůžek J (2011) Accuracy and reliability in sex determination from skulls: a comparison of Fordisc® 3.0 and the discriminant function analysis. Forensic Sci Int 208:180-e1CrossRef
35.
go back to reference Jantz RL, Ousley SD (2005) FORDISC 3: computerized forensic discriminant functions. Version 3.0. The University of Tennessee, Knoxville Jantz RL, Ousley SD (2005) FORDISC 3: computerized forensic discriminant functions. Version 3.0. The University of Tennessee, Knoxville
37.
go back to reference Jerković I, Bašić Ž, Kružić I, Anđelinović Š (2018) Creating reference data on sex for ancient populations using the Probabilistic Sex Diagnosis method: a validation test using the results of aDNA analysis. J Archaeol Sci 94:44–50CrossRef Jerković I, Bašić Ž, Kružić I, Anđelinović Š (2018) Creating reference data on sex for ancient populations using the Probabilistic Sex Diagnosis method: a validation test using the results of aDNA analysis. J Archaeol Sci 94:44–50CrossRef
39.
go back to reference Klales A (2020a) MorphoPASSE: morphological pelvis and skull sex estimation program. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 271–278CrossRef Klales A (2020a) MorphoPASSE: morphological pelvis and skull sex estimation program. In: Klales A (ed) Sex estimation of the human skeleton. Academic Press, pp 271–278CrossRef
40.
go back to reference Klales A (2018a) MorphoPASSE: the morphological pelvis and skull sex estimation database. Version 1.0. Washburn, University, Topeka Klales A (2018a) MorphoPASSE: the morphological pelvis and skull sex estimation database. Version 1.0. Washburn, University, Topeka
41.
go back to reference Klales A (2020b) Practitioner preferences for sex estimation from human skeletal remains. In: Klales A (ed) Sex Estimation of the Human Skeleton. Academic Press, pp 11–23CrossRef Klales A (2020b) Practitioner preferences for sex estimation from human skeletal remains. In: Klales A (ed) Sex Estimation of the Human Skeleton. Academic Press, pp 11–23CrossRef
42.
go back to reference Klales A, Cole S (2018) MorphoPASSE: the morphological pelvis and skull sex estimation database manual. Version 1.0. Washburn, University, Topeka Klales A, Cole S (2018) MorphoPASSE: the morphological pelvis and skull sex estimation database manual. Version 1.0. Washburn, University, Topeka
43.
go back to reference Klales AR (2018b) Introducing MorphoPASSE: the morphological pelvis and skull sex estimation database. In: Proceedings of the 70th Annual Scientific Meeting of the American Academy of Forensic Sciences in Seattle. Wa Klales AR (2018b) Introducing MorphoPASSE: the morphological pelvis and skull sex estimation database. In: Proceedings of the 70th Annual Scientific Meeting of the American Academy of Forensic Sciences in Seattle. Wa
44.
go back to reference Klales AR, Ousley SD, Vollner JM (2012) A revised method of sexing the human innominate using Phenice’s nonmetric traits and statistical methods. Am J Phys Anthropol 149:104–114CrossRefPubMed Klales AR, Ousley SD, Vollner JM (2012) A revised method of sexing the human innominate using Phenice’s nonmetric traits and statistical methods. Am J Phys Anthropol 149:104–114CrossRefPubMed
45.
go back to reference Kotěrová A, Rmoutilová R, Brůžek J (2022) Current trends in methods for estimating age and sex from the adult human skeleton. Anthropologie 60:225–252CrossRef Kotěrová A, Rmoutilová R, Brůžek J (2022) Current trends in methods for estimating age and sex from the adult human skeleton. Anthropologie 60:225–252CrossRef
46.
go back to reference Kotěrová A, Velemínská J, Dupej J et al (2016) Disregarding population specificity: its influence on the sex assessment methods from the tibia. Int J Legal Med 131:251–261CrossRefPubMed Kotěrová A, Velemínská J, Dupej J et al (2016) Disregarding population specificity: its influence on the sex assessment methods from the tibia. Int J Legal Med 131:251–261CrossRefPubMed
48.
go back to reference Krishan K, Chatterjee PM, Kanchan T et al (2016) A review of sex estimation techniques during examination of skeletal remains in forensic anthropology casework. Forensic Sci Int 261:165.e1-165.e8CrossRefPubMed Krishan K, Chatterjee PM, Kanchan T et al (2016) A review of sex estimation techniques during examination of skeletal remains in forensic anthropology casework. Forensic Sci Int 261:165.e1-165.e8CrossRefPubMed
50.
go back to reference Lesciotto K (2015) The impact of Daubert on the admissibility of forensic anthropology expert testimony. J Forensic Sci 60:549–555CrossRefPubMed Lesciotto K (2015) The impact of Daubert on the admissibility of forensic anthropology expert testimony. J Forensic Sci 60:549–555CrossRefPubMed
51.
go back to reference Lewis, Garvin HM (2016) Reliability of the Walker cranial nonmetric method and implications for sex estimation. J Forensic Sci 61:743–751CrossRefPubMed Lewis, Garvin HM (2016) Reliability of the Walker cranial nonmetric method and implications for sex estimation. J Forensic Sci 61:743–751CrossRefPubMed
55.
go back to reference Murail P, Brůžek J, Houët F, Cunha E (2005) DSP: a tool for probabilistic sex diagnosis using worldwide variability in hip-bone measurements. Bull Mém Soc Anthropol Paris 17:167–176CrossRef Murail P, Brůžek J, Houët F, Cunha E (2005) DSP: a tool for probabilistic sex diagnosis using worldwide variability in hip-bone measurements. Bull Mém Soc Anthropol Paris 17:167–176CrossRef
56.
go back to reference Nikita E, Michopoulou E (2018) A quantitative approach for sex estimation based on cranial morphology. Am J Phys Anthropol 165:507–517CrossRefPubMed Nikita E, Michopoulou E (2018) A quantitative approach for sex estimation based on cranial morphology. Am J Phys Anthropol 165:507–517CrossRefPubMed
57.
go back to reference Oikonomopoulou EK, Valakos E, Nikita E (2017) Population-specificity of sexual dimorphism in cranial and pelvic traits: evaluation of existing and proposal of new functions for sex assessment in a Greek assemblage. Int J Legal Med 131:1731–1738CrossRefPubMed Oikonomopoulou EK, Valakos E, Nikita E (2017) Population-specificity of sexual dimorphism in cranial and pelvic traits: evaluation of existing and proposal of new functions for sex assessment in a Greek assemblage. Int J Legal Med 131:1731–1738CrossRefPubMed
58.
go back to reference Phenice T (1969) A newly developed visual method of sexing the os pubis. Am J Phys Anthropol 30:297–301CrossRefPubMed Phenice T (1969) A newly developed visual method of sexing the os pubis. Am J Phys Anthropol 30:297–301CrossRefPubMed
59.
go back to reference R Core Team (2023) R: a language and environment for statistical computing R Core Team (2023) R: a language and environment for statistical computing
60.
go back to reference Ramsthaler F, Kreutz K, Verhoff MA (2007) Accuracy of metric sex analysis of skeletal remains using Fordisc® based on a recent skull collection. Int J Legal Med 121:477–482CrossRefPubMed Ramsthaler F, Kreutz K, Verhoff MA (2007) Accuracy of metric sex analysis of skeletal remains using Fordisc® based on a recent skull collection. Int J Legal Med 121:477–482CrossRefPubMed
61.
go back to reference Santos F (2021) rdss: an R package to facilitate the use of Murail et al’.s (1999) approach of sex estimation in past populations. Int J Osteoarchaeol 31:382–392CrossRef Santos F (2021) rdss: an R package to facilitate the use of Murail et al’.s (1999) approach of sex estimation in past populations. Int J Osteoarchaeol 31:382–392CrossRef
62.
go back to reference Slice DE, Ross A (2009) 3D-ID: geometric morphometric classification of crania for forensic scientists. Proc Natl Acad Sci USA 106:2124–2129PubMedPubMedCentral Slice DE, Ross A (2009) 3D-ID: geometric morphometric classification of crania for forensic scientists. Proc Natl Acad Sci USA 106:2124–2129PubMedPubMedCentral
63.
go back to reference Stevenson JC, Mahoney ER, Walker PL, Everson PM (2009) Prediction of sex based on five skull traits using decision analysis (CHAID). Am J Phys Anthropol 139:434–441CrossRefPubMed Stevenson JC, Mahoney ER, Walker PL, Everson PM (2009) Prediction of sex based on five skull traits using decision analysis (CHAID). Am J Phys Anthropol 139:434–441CrossRefPubMed
65.
go back to reference Tallman S (2019) Cranial nonmetric sexual dimorphism and sex estimation in East and Southeast Asian individuals. Forensic Anthropol 4:204–221 Tallman S (2019) Cranial nonmetric sexual dimorphism and sex estimation in East and Southeast Asian individuals. Forensic Anthropol 4:204–221
69.
go back to reference Urbanová P, Ross AH, Jurda M, Nogueira MI (2014) Testing the reliability of software tools in sex and ancestry estimation in a multi-ancestral Brazilian sample. Leg Med 16:264–273CrossRef Urbanová P, Ross AH, Jurda M, Nogueira MI (2014) Testing the reliability of software tools in sex and ancestry estimation in a multi-ancestral Brazilian sample. Leg Med 16:264–273CrossRef
70.
go back to reference Vargas DS, St John ME, Garcia-Bernabe JR, DiGangi EA (2022) MorphoPASSE skull sexing error. Am J Biol Anthropol 177:159–160 Vargas DS, St John ME, Garcia-Bernabe JR, DiGangi EA (2022) MorphoPASSE skull sexing error. Am J Biol Anthropol 177:159–160
72.
go back to reference Walrath D, Turner P, Bruzek J (2004) Reliability test of the visual assessment of cranial traits for sex determination. Am J Phys Anthr 125:132–137CrossRef Walrath D, Turner P, Bruzek J (2004) Reliability test of the visual assessment of cranial traits for sex determination. Am J Phys Anthr 125:132–137CrossRef
75.
go back to reference Zejdlik K, Nyárádi Z, Gonciar A (2021) Evidence of horsemanship in two Szekler noblemen from the Baroque period. Int J Osteoarchaeol 31:66–76CrossRef Zejdlik K, Nyárádi Z, Gonciar A (2021) Evidence of horsemanship in two Szekler noblemen from the Baroque period. Int J Osteoarchaeol 31:66–76CrossRef
Metadata
Title
Prioritizing a high posterior probability threshold leading to low error rate over high classification accuracy: the validity of MorphoPASSE software for cranial morphological sex estimation in a contemporary population
Authors
Anežka Pilmann Kotěrová
Frédéric Santos
Šárka Bejdová
Rebeka Rmoutilová
MennattAllah Hassan Attia
Ahmed Habiba
Jana Velemínská
Jaroslav Brůžek
Publication date
26-03-2024
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Legal Medicine
Print ISSN: 0937-9827
Electronic ISSN: 1437-1596
DOI
https://doi.org/10.1007/s00414-024-03215-1