Skip to main content
Top
Published in: BMC Medical Imaging 1/2014

Open Access 01-12-2014 | Research article

3D facial landmarks: Inter-operator variability of manual annotation

Authors: Jens Fagertun, Stine Harder, Anders Rosengren, Christian Moeller, Thomas Werge, Rasmus R Paulsen, Thomas F Hansen

Published in: BMC Medical Imaging | Issue 1/2014

Login to get access

Abstract

Background

Manual annotation of landmarks is a known source of variance, which exist in all fields of medical imaging, influencing the accuracy and interpretation of the results. However, the variability of human facial landmarks is only sparsely addressed in the current literature as opposed to e.g. the research fields of orthodontics and cephalometrics. We present a full facial 3D annotation procedure and a sparse set of manually annotated landmarks, in effort to reduce operator time and minimize the variance.

Method

Facial scans from 36 voluntary unrelated blood donors from the Danish Blood Donor Study was randomly chosen. Six operators twice manually annotated 73 anatomical and pseudo-landmarks, using a three-step scheme producing a dense point correspondence map. We analyzed both the intra- and inter-operator variability, using mixed-model ANOVA. We then compared four sparse sets of landmarks in order to construct a dense correspondence map of the 3D scans with a minimum point variance.

Results

The anatomical landmarks of the eye were associated with the lowest variance, particularly the center of the pupils. Whereas points of the jaw and eyebrows have the highest variation. We see marginal variability in regards to intra-operator and portraits. Using a sparse set of landmarks (n=14), that capture the whole face, the dense point mean variance was reduced from 1.92 to 0.54 mm.

Conclusion

The inter-operator variability was primarily associated with particular landmarks, where more leniently landmarks had the highest variability. The variables embedded in the portray and the reliability of a trained operator did only have marginal influence on the variability. Further, using 14 of the annotated landmarks we were able to reduced the variability and create a dense correspondences mesh to capture all facial features.
Appendix
Available only for authorised users
Literature
1.
go back to reference Chinthapalli K, Bartolini E, Novy J, Suttie M, Marini C, Falchi M, Fox Z, Clayton LMS, Sander JW, Guerrini R, Depondt C, Hennekam R, Hammond P, Sisodiya SM: Atypical face shape and genomic structural variants in epilepsy. Brain: J Neurol. 2012, 135 (10): 3101-3114.CrossRef Chinthapalli K, Bartolini E, Novy J, Suttie M, Marini C, Falchi M, Fox Z, Clayton LMS, Sander JW, Guerrini R, Depondt C, Hennekam R, Hammond P, Sisodiya SM: Atypical face shape and genomic structural variants in epilepsy. Brain: J Neurol. 2012, 135 (10): 3101-3114.CrossRef
2.
go back to reference Liu F, van der Lijn F, Schurmann C, Zhu G, Chakravarty MM, Hysi PG, Wollstein A, Lao O, de Bruijne M, Ikram MA, van der Lugt A, Rivadeneira F, Uitterlinden AG, Hofman A, Niessen WJ, Homuth G, de Zubicaray G, McMahon KL, Thompson PM, Daboul A, Puls R, Hegenscheid K, Bevan L, Pausova Z, Medland SE, Montgomery GW, Wright MJ, Wicking C, Boehringer S, Spector TD, et al: A genome-wide association study identifies five loci influencing facial morphology in Europeans. PLoS Genet. 2012, 8 (9): e1002932-CrossRefPubMedPubMedCentral Liu F, van der Lijn F, Schurmann C, Zhu G, Chakravarty MM, Hysi PG, Wollstein A, Lao O, de Bruijne M, Ikram MA, van der Lugt A, Rivadeneira F, Uitterlinden AG, Hofman A, Niessen WJ, Homuth G, de Zubicaray G, McMahon KL, Thompson PM, Daboul A, Puls R, Hegenscheid K, Bevan L, Pausova Z, Medland SE, Montgomery GW, Wright MJ, Wicking C, Boehringer S, Spector TD, et al: A genome-wide association study identifies five loci influencing facial morphology in Europeans. PLoS Genet. 2012, 8 (9): e1002932-CrossRefPubMedPubMedCentral
3.
go back to reference Paternoster L, Zhurov AI, Toma AM, Kemp JP, St Pourcain B, Timpson NJ, McMahon G, McArdle W, Ring SM, Smith GD, Richmond S, Evans DM: Genome-wide association study of three-dimensional facial morphology identifies a variant in PAX3 associated with nasion position. Am J Hum Genet. 2012, 90 (3): 478-485.CrossRefPubMedPubMedCentral Paternoster L, Zhurov AI, Toma AM, Kemp JP, St Pourcain B, Timpson NJ, McMahon G, McArdle W, Ring SM, Smith GD, Richmond S, Evans DM: Genome-wide association study of three-dimensional facial morphology identifies a variant in PAX3 associated with nasion position. Am J Hum Genet. 2012, 90 (3): 478-485.CrossRefPubMedPubMedCentral
4.
go back to reference Hammond P, Hutton TJ, Allanson JE, Campbell LE, Hennekam RCM, Holden S, Patton MA, Shaw A, Temple IK, Trotter M, Murphy KC, Winter RM: 3D analysis of facial morphology. Am J Med Genet Part A. 2004, 126A (4): 339-348.CrossRefPubMed Hammond P, Hutton TJ, Allanson JE, Campbell LE, Hennekam RCM, Holden S, Patton MA, Shaw A, Temple IK, Trotter M, Murphy KC, Winter RM: 3D analysis of facial morphology. Am J Med Genet Part A. 2004, 126A (4): 339-348.CrossRefPubMed
5.
go back to reference Hutton TJ, Buxton BR, Hammond P: Dense surface point distribution models of the human face. Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001). 2001, IEEE, 153-160.CrossRef Hutton TJ, Buxton BR, Hammond P: Dense surface point distribution models of the human face. Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001). 2001, IEEE, 153-160.CrossRef
6.
go back to reference Paulsen RR, Hilger KB: Shape modelling using markov random field restoration of point correspondences. Inf Process Med Imaging. 2003, 18: 1-12.CrossRefPubMed Paulsen RR, Hilger KB: Shape modelling using markov random field restoration of point correspondences. Inf Process Med Imaging. 2003, 18: 1-12.CrossRefPubMed
7.
go back to reference Douglas TS: Image processing for craniofacial landmark identification and measurement: a review of photogrammetry and cephalometry. Comput Med Imaging Graph. 2004, 28 (7): 401-409.CrossRefPubMed Douglas TS: Image processing for craniofacial landmark identification and measurement: a review of photogrammetry and cephalometry. Comput Med Imaging Graph. 2004, 28 (7): 401-409.CrossRefPubMed
8.
go back to reference Buschang PH, Tanguay R, Demirjian A: Cephalometric reliability: a full ANOVA model for the estimation of true and error variance. Angle Orthod. 1987, 57 (2): 168-175.PubMed Buschang PH, Tanguay R, Demirjian A: Cephalometric reliability: a full ANOVA model for the estimation of true and error variance. Angle Orthod. 1987, 57 (2): 168-175.PubMed
9.
go back to reference von Cramon-Taubadel N, Frazier BC, Lahr MM: The problem of assessing landmark error in geometric morphometrics: theory, methods, and modifications. Am J Phys Anthropol. 2007, 134 (1): 24-35.CrossRefPubMed von Cramon-Taubadel N, Frazier BC, Lahr MM: The problem of assessing landmark error in geometric morphometrics: theory, methods, and modifications. Am J Phys Anthropol. 2007, 134 (1): 24-35.CrossRefPubMed
10.
go back to reference Sholts S, Flores L, Walker P, Wärmländer S: Comparison of coordinate measurement precision of different landmark types on human crania using a 3D laser scanner and a 3D digitiser: implications for applications of digital morphometrics. Int J Osteoarchaeol. 2011, 21 (5): 535-543.CrossRef Sholts S, Flores L, Walker P, Wärmländer S: Comparison of coordinate measurement precision of different landmark types on human crania using a 3D laser scanner and a 3D digitiser: implications for applications of digital morphometrics. Int J Osteoarchaeol. 2011, 21 (5): 535-543.CrossRef
11.
go back to reference Barbeito-Andrés J, Anzelmo M, Ventrice F, Sardi ML: Measurement error of 3D cranial landmarks of an ontogenetic sample using computed tomography. J Oral Biol Craniof Res. 2012, 2 (2): 77-82.CrossRef Barbeito-Andrés J, Anzelmo M, Ventrice F, Sardi ML: Measurement error of 3D cranial landmarks of an ontogenetic sample using computed tomography. J Oral Biol Craniof Res. 2012, 2 (2): 77-82.CrossRef
12.
go back to reference Larsen R, Baggesen K: Statistical shape analysis using non-euclidean metrics. Med Image Anal. 2003, 7 (4): 417-423.CrossRefPubMed Larsen R, Baggesen K: Statistical shape analysis using non-euclidean metrics. Med Image Anal. 2003, 7 (4): 417-423.CrossRefPubMed
13.
go back to reference Pedersen OB, Erikstrup C, Kotzé SR, Sørensen E, Petersen MS, Grau K, Ullum H: The Danish blood donor study: a large, prospective cohort and biobank for medical research. Vox Sang. 2012, 102 (3): 271-CrossRefPubMed Pedersen OB, Erikstrup C, Kotzé SR, Sørensen E, Petersen MS, Grau K, Ullum H: The Danish blood donor study: a large, prospective cohort and biobank for medical research. Vox Sang. 2012, 102 (3): 271-CrossRefPubMed
14.
go back to reference Fagertun J: Face Recognition. M.sc.eng. thesis. Technical University of Denmark; 2005 Fagertun J: Face Recognition. M.sc.eng. thesis. Technical University of Denmark; 2005
15.
go back to reference Cootes TF, Edwards GJ, Taylor CJ: Active appearance models. IEEE Trans Pattern Anal Mach Intell. 2001, 23 (6): 681-685.CrossRef Cootes TF, Edwards GJ, Taylor CJ: Active appearance models. IEEE Trans Pattern Anal Mach Intell. 2001, 23 (6): 681-685.CrossRef
16.
go back to reference Cootes TF, Taylor CJ, Cooper DH, Graham J: Active shape models-their training and application. Comput Vis Image Underst. 1995, 61 (1): 38-59.CrossRef Cootes TF, Taylor CJ, Cooper DH, Graham J: Active shape models-their training and application. Comput Vis Image Underst. 1995, 61 (1): 38-59.CrossRef
17.
go back to reference Viola P, Jones MJ: Robust real-time face detection. Int J Comput Vis. 2004, 57 (2): 137-154.CrossRef Viola P, Jones MJ: Robust real-time face detection. Int J Comput Vis. 2004, 57 (2): 137-154.CrossRef
18.
go back to reference Viola P, Jones MJ: Robust real-time object detection. Proc. of IEEE workshop on Statistical and Computational Theories of Vision. 2001, IEEE Viola P, Jones MJ: Robust real-time object detection. Proc. of IEEE workshop on Statistical and Computational Theories of Vision. 2001, IEEE
19.
go back to reference Zhang Z: Iterative point matching for registration of free-form curves and surfaces. Int J Comput Vis. 1994, 13 (2): 119-152.CrossRef Zhang Z: Iterative point matching for registration of free-form curves and surfaces. Int J Comput Vis. 1994, 13 (2): 119-152.CrossRef
20.
go back to reference Bookstein FL: Principal warps: thin-plate splines and the decomposition of deformations. Pattern Anal Mach Intell IEEE Trans. 1989, 11 (6): 567-585.CrossRef Bookstein FL: Principal warps: thin-plate splines and the decomposition of deformations. Pattern Anal Mach Intell IEEE Trans. 1989, 11 (6): 567-585.CrossRef
21.
go back to reference Hilger KB, Paulsen RR, Larsen R: Markov random field restoration of point correspondences for active shape modeling. Medical Imaging 2004. 2004, International Society for Optics and Photonics, 1862-1869.CrossRef Hilger KB, Paulsen RR, Larsen R: Markov random field restoration of point correspondences for active shape modeling. Medical Imaging 2004. 2004, International Society for Optics and Photonics, 1862-1869.CrossRef
22.
go back to reference Li SZ: Markov Random Field Modeling in Image Analysis. 2009, Springer Li SZ: Markov Random Field Modeling in Image Analysis. 2009, Springer
23.
go back to reference Paulsen RR: Statistical shape analysis of the human ear canal with application to in-the-ear hearing aid design. Ph.D. thesis. IMM, Informatik og Matematisk Modellering, Danmarks Tekniske Universitet; 2004 Paulsen RR: Statistical shape analysis of the human ear canal with application to in-the-ear hearing aid design. Ph.D. thesis. IMM, Informatik og Matematisk Modellering, Danmarks Tekniske Universitet; 2004
24.
go back to reference Sugano N: Computer-assisted orthopedic surgery. J Orthopaedic Sci. 2003, 8 (3): 442-448.CrossRef Sugano N: Computer-assisted orthopedic surgery. J Orthopaedic Sci. 2003, 8 (3): 442-448.CrossRef
Metadata
Title
3D facial landmarks: Inter-operator variability of manual annotation
Authors
Jens Fagertun
Stine Harder
Anders Rosengren
Christian Moeller
Thomas Werge
Rasmus R Paulsen
Thomas F Hansen
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Imaging / Issue 1/2014
Electronic ISSN: 1471-2342
DOI
https://doi.org/10.1186/1471-2342-14-35

Other articles of this Issue 1/2014

BMC Medical Imaging 1/2014 Go to the issue