Skip to main content
Top
Published in: BMC Medical Imaging 1/2015

Open Access 01-12-2015 | Research article

Eigen-disfigurement model for simulating plausible facial disfigurement after reconstructive surgery

Authors: Juhun Lee, Michelle C Fingeret, Alan C Bovik, Gregory P Reece, Roman J Skoracki, Matthew M Hanasono, Mia K Markey

Published in: BMC Medical Imaging | Issue 1/2015

Login to get access

Abstract

Background

Patients with facial cancers can experience disfigurement as they may undergo considerable appearance changes from their illness and its treatment. Individuals with difficulties adjusting to facial cancer are concerned about how others perceive and evaluate their appearance. Therefore, it is important to understand how humans perceive disfigured faces. We describe a new strategy that allows simulation of surgically plausible facial disfigurement on a novel face for elucidating the human perception on facial disfigurement.

Method

Longitudinal 3D facial images of patients (N = 17) with facial disfigurement due to cancer treatment were replicated using a facial mannequin model, by applying Thin-Plate Spline (TPS) warping and linear interpolation on the facial mannequin model in polar coordinates. Principal Component Analysis (PCA) was used to capture longitudinal structural and textural variations found within each patient with facial disfigurement arising from the treatment. We treated such variations as disfigurement. Each disfigurement was smoothly stitched on a healthy face by seeking a Poisson solution to guided interpolation using the gradient of the learned disfigurement as the guidance field vector. The modeling technique was quantitatively evaluated. In addition, panel ratings of experienced medical professionals on the plausibility of simulation were used to evaluate the proposed disfigurement model.

Results

The algorithm reproduced the given face effectively using a facial mannequin model with less than 4.4 mm maximum error for the validation fiducial points that were not used for the processing. Panel ratings of experienced medical professionals on the plausibility of simulation showed that the disfigurement model (especially for peripheral disfigurement) yielded predictions comparable to the real disfigurements.

Conclusions

The modeling technique of this study is able to capture facial disfigurements and its simulation represents plausible outcomes of reconstructive surgery for facial cancers. Thus, our technique can be used to study human perception on facial disfigurement.
Appendix
Available only for authorised users
Literature
1.
go back to reference Fingeret MC, Vidrine DJ, Reece GP, Gillenwater AM, Gritz ER. Multidimensional analysis of body image concerns among newly diagnosed patients with oral cavity cancer. Head Neck. 2010;32:301–9.PubMedPubMedCentral Fingeret MC, Vidrine DJ, Reece GP, Gillenwater AM, Gritz ER. Multidimensional analysis of body image concerns among newly diagnosed patients with oral cavity cancer. Head Neck. 2010;32:301–9.PubMedPubMedCentral
2.
go back to reference Fingeret MC, Hutcheson KA, Jensen K, Yuan Y, Urbauer D, Lewin JS. Associations among speech, eating, and body image concerns for surgical patients with head and neck cancer. Head Neck. 2013;35:354–60.CrossRefPubMed Fingeret MC, Hutcheson KA, Jensen K, Yuan Y, Urbauer D, Lewin JS. Associations among speech, eating, and body image concerns for surgical patients with head and neck cancer. Head Neck. 2013;35:354–60.CrossRefPubMed
3.
go back to reference Fingeret MC, Yuan Y, Urbauer D, Weston J, Nipomnick S, Weber R. The nature and extent of body image concerns among surgically treated patients with head and neck cancer. Psychooncology. 2011;8:836–44. Fingeret MC, Yuan Y, Urbauer D, Weston J, Nipomnick S, Weber R. The nature and extent of body image concerns among surgically treated patients with head and neck cancer. Psychooncology. 2011;8:836–44.
4.
go back to reference Strauss RP. Psychosocial responses to oral and maxillofacial surgery for head and neck cancer. J Oral Maxillofac Surg Off J Am Assoc Oral Maxillofac Surg. 1989;47:343–8.CrossRef Strauss RP. Psychosocial responses to oral and maxillofacial surgery for head and neck cancer. J Oral Maxillofac Surg Off J Am Assoc Oral Maxillofac Surg. 1989;47:343–8.CrossRef
5.
go back to reference Gamba A, Romano M, Grosso IM, Tamburini M, Cantú G, Molinari R, et al. Psychosocial adjustment of patients surgically treated for head and neck cancer. Head Neck. 1992;14:218–23.CrossRefPubMed Gamba A, Romano M, Grosso IM, Tamburini M, Cantú G, Molinari R, et al. Psychosocial adjustment of patients surgically treated for head and neck cancer. Head Neck. 1992;14:218–23.CrossRefPubMed
6.
go back to reference Katz MR, Irish JC, Devins GM, Rodin GM, Gullane PJ. Psychosocial adjustment in head and neck cancer: the impact of disfigurement, gender and social support. Head Neck. 2003;25:103–12.CrossRefPubMed Katz MR, Irish JC, Devins GM, Rodin GM, Gullane PJ. Psychosocial adjustment in head and neck cancer: the impact of disfigurement, gender and social support. Head Neck. 2003;25:103–12.CrossRefPubMed
7.
go back to reference Hagedoorn M, Molleman E. Facial disfigurement in patients with head and neck cancer: the role of social self-efficacy. Health Psychol. 2006;25:643–7.CrossRefPubMed Hagedoorn M, Molleman E. Facial disfigurement in patients with head and neck cancer: the role of social self-efficacy. Health Psychol. 2006;25:643–7.CrossRefPubMed
8.
go back to reference Rumsey N, Harcourt D. Body image and disfigurement: issues and interventions. Body Image. 2004;1:83–97.CrossRefPubMed Rumsey N, Harcourt D. Body image and disfigurement: issues and interventions. Body Image. 2004;1:83–97.CrossRefPubMed
9.
go back to reference Rumsey N, Byron-Daniel J, Charlton R, Clarke A, Clarke S-A, Harcourt D, et al. Identifying the Psychosocial Factors and Processes Contributing to Successful Adjustment to Disfiguring Conditions. Bristol: University of the West of England; 2008. Rumsey N, Byron-Daniel J, Charlton R, Clarke A, Clarke S-A, Harcourt D, et al. Identifying the Psychosocial Factors and Processes Contributing to Successful Adjustment to Disfiguring Conditions. Bristol: University of the West of England; 2008.
10.
go back to reference Xia J, Ip HH, Samman N, Wong HT, Gateno J, Wang D, et al. Three-dimensional virtual-reality surgical planning and soft-tissue prediction for orthognathic surgery. IEEE Trans Inf Technol Biomed Publ IEEE Eng Med Biol Soc. 2001;5:97–107.CrossRef Xia J, Ip HH, Samman N, Wong HT, Gateno J, Wang D, et al. Three-dimensional virtual-reality surgical planning and soft-tissue prediction for orthognathic surgery. IEEE Trans Inf Technol Biomed Publ IEEE Eng Med Biol Soc. 2001;5:97–107.CrossRef
11.
go back to reference Xia J, Samman N, Yeung RW, Wang D, Shen SG, Ip HH, et al. Computer-assisted three-dimensional surgical planing and simulation. 3D soft tissue planning and prediction. Int J Oral Maxillofac Surg. 2000;29:250–8.CrossRefPubMed Xia J, Samman N, Yeung RW, Wang D, Shen SG, Ip HH, et al. Computer-assisted three-dimensional surgical planing and simulation. 3D soft tissue planning and prediction. Int J Oral Maxillofac Surg. 2000;29:250–8.CrossRefPubMed
12.
go back to reference Gladilin E, Ivanov A. Computational modelling and optimisation of soft tissue outcome in cranio-maxillofacial surgery planning. Comput Methods Biomech Biomed Engin. 2009;12:305–18.CrossRefPubMed Gladilin E, Ivanov A. Computational modelling and optimisation of soft tissue outcome in cranio-maxillofacial surgery planning. Comput Methods Biomech Biomed Engin. 2009;12:305–18.CrossRefPubMed
13.
go back to reference Flores RL, Deluccia N, Grayson BH, Oliker A, McCarthy JG. Creating a virtual surgical atlas of craniofacial procedures: Part I. Three-dimensional digital models of craniofacial deformities. Plast Reconstr Surg. 2010;126:2084–92.CrossRefPubMed Flores RL, Deluccia N, Grayson BH, Oliker A, McCarthy JG. Creating a virtual surgical atlas of craniofacial procedures: Part I. Three-dimensional digital models of craniofacial deformities. Plast Reconstr Surg. 2010;126:2084–92.CrossRefPubMed
14.
go back to reference Mollemans W, Schutyser F, Nadjmi N, Maes F, Suetens P. Predicting soft tissue deformations for a maxillofacial surgery planning system: from computational strategies to a complete clinical validation. Med Image Anal. 2007;11:282–301.CrossRefPubMed Mollemans W, Schutyser F, Nadjmi N, Maes F, Suetens P. Predicting soft tissue deformations for a maxillofacial surgery planning system: from computational strategies to a complete clinical validation. Med Image Anal. 2007;11:282–301.CrossRefPubMed
15.
go back to reference Westermark A, Zachow S, Eppley BL. Three-dimensional osteotomy planning in maxillofacial surgery including soft tissue prediction. J Craniofac Surg. 2005;16:100–4.CrossRefPubMed Westermark A, Zachow S, Eppley BL. Three-dimensional osteotomy planning in maxillofacial surgery including soft tissue prediction. J Craniofac Surg. 2005;16:100–4.CrossRefPubMed
16.
go back to reference Marchetti C, Bianchi A, Muyldermans L, Di Martino M, Lancellotti L, Sarti A. Validation of new soft tissue software in orthognathic surgery planning. Int J Oral Maxillofac Surg. 2011;40:26–32.CrossRefPubMed Marchetti C, Bianchi A, Muyldermans L, Di Martino M, Lancellotti L, Sarti A. Validation of new soft tissue software in orthognathic surgery planning. Int J Oral Maxillofac Surg. 2011;40:26–32.CrossRefPubMed
17.
go back to reference Wang J, Liao S, Zhu X, Wang Y, Ling C, Ding X, et al. Real time 3D simulation for nose surgery and automatic individual prosthesis design. Comput Methods Programs Biomed. 2011;104:472–9.CrossRefPubMed Wang J, Liao S, Zhu X, Wang Y, Ling C, Ding X, et al. Real time 3D simulation for nose surgery and automatic individual prosthesis design. Comput Methods Programs Biomed. 2011;104:472–9.CrossRefPubMed
18.
go back to reference Lee T-Y, Lin C-H, Lin H-Y. Computer-aided prototype system for nose surgery. Inf Technol Biomed IEEE Trans. 2001;5:271–8.CrossRef Lee T-Y, Lin C-H, Lin H-Y. Computer-aided prototype system for nose surgery. Inf Technol Biomed IEEE Trans. 2001;5:271–8.CrossRef
19.
go back to reference Lee T-Y, Sum Y-N, Lin Y-C, Lin L, Lee C. Three-dimensional facial model reconstruction and plastic surgery simulation. IEEE Trans Inf Technol Biomed. 1999;3:214–20.CrossRefPubMed Lee T-Y, Sum Y-N, Lin Y-C, Lin L, Lee C. Three-dimensional facial model reconstruction and plastic surgery simulation. IEEE Trans Inf Technol Biomed. 1999;3:214–20.CrossRefPubMed
20.
go back to reference Gao J, Zhou M, Wang H, Zhang C. Three dimensional surface warping for plastic surgery planning. In: 2001 IEEE Int Conf Syst Man Cybern. Volume 3; 2016–2021 vol.3. Tucson, AZ: IEEE; 2001. Gao J, Zhou M, Wang H, Zhang C. Three dimensional surface warping for plastic surgery planning. In: 2001 IEEE Int Conf Syst Man Cybern. Volume 3; 2016–2021 vol.3. Tucson, AZ: IEEE; 2001.
21.
go back to reference Liao S, Tong R, Geng J-P, Tang M. Inhomogeneous volumetric Laplacian deformation for rhinoplasty planning and simulation system. Comput Animat Virtual Worlds. 2010;21:331–41. Liao S, Tong R, Geng J-P, Tang M. Inhomogeneous volumetric Laplacian deformation for rhinoplasty planning and simulation system. Comput Animat Virtual Worlds. 2010;21:331–41.
22.
go back to reference Bottino A, De Simone M, Laurentini A, Sforza C. A new 3-D tool for planning plastic surgery. Biomed Eng IEEE Trans. 2012;59:3439–49.CrossRef Bottino A, De Simone M, Laurentini A, Sforza C. A new 3-D tool for planning plastic surgery. Biomed Eng IEEE Trans. 2012;59:3439–49.CrossRef
23.
go back to reference Claes P, Walters M, Gillett D, Vandermeulen D, Clement JG, Suetens P. The normal-equivalent: a patient-specific assessment of facial harmony. Int J Oral Maxillofac Surg. 2013;42:1150–8.CrossRefPubMed Claes P, Walters M, Gillett D, Vandermeulen D, Clement JG, Suetens P. The normal-equivalent: a patient-specific assessment of facial harmony. Int J Oral Maxillofac Surg. 2013;42:1150–8.CrossRefPubMed
24.
go back to reference Yin L, Wei X, Sun Y, Wang J, Rosato MJ. A 3D facial expression database for facial behavior research. In: 7th Int Conf Autom Face Gesture Recognit 2006 FGR 2006. Southampton, United Kingdom: IEEE Computer Society; 2006. p. 211–6. Yin L, Wei X, Sun Y, Wang J, Rosato MJ. A 3D facial expression database for facial behavior research. In: 7th Int Conf Autom Face Gesture Recognit 2006 FGR 2006. Southampton, United Kingdom: IEEE Computer Society; 2006. p. 211–6.
26.
go back to reference Cootes TF, Edwards GJ, Taylor CJ. Active appearance models. IEEE Trans Pattern Anal Mach Intell. 2001;23:681–5.CrossRef Cootes TF, Edwards GJ, Taylor CJ. Active appearance models. IEEE Trans Pattern Anal Mach Intell. 2001;23:681–5.CrossRef
27.
28.
go back to reference Hutton TJ, Buxton BF, Hammond P, Potts HWW. Estimating average growth trajectories in shape-space using kernel smoothing. IEEE Trans Med Imaging. 2003;22:747–53.CrossRefPubMed Hutton TJ, Buxton BF, Hammond P, Potts HWW. Estimating average growth trajectories in shape-space using kernel smoothing. IEEE Trans Med Imaging. 2003;22:747–53.CrossRefPubMed
29.
go back to reference Claes P, Walters M, Clement J. Improved facial outcome assessment using a 3D anthropometric mask. Int J Oral Maxillofac Surg. 2012;41:324–30.CrossRefPubMed Claes P, Walters M, Clement J. Improved facial outcome assessment using a 3D anthropometric mask. Int J Oral Maxillofac Surg. 2012;41:324–30.CrossRefPubMed
30.
go back to reference Claes P, Walters M, Vandermeulen D, Clement JG. Spatially-dense 3D facial asymmetry assessment in both typical and disordered growth. J Anat. 2011;219:444–55.CrossRefPubMedPubMedCentral Claes P, Walters M, Vandermeulen D, Clement JG. Spatially-dense 3D facial asymmetry assessment in both typical and disordered growth. J Anat. 2011;219:444–55.CrossRefPubMedPubMedCentral
31.
go back to reference Hammond P, Hutton TJ, Allanson JE, Campbell LE, Hennekam RCM, Holden S, et al. 3D analysis of facial morphology. Am J Med Genet A. 2004;126A:339–48.CrossRefPubMed Hammond P, Hutton TJ, Allanson JE, Campbell LE, Hennekam RCM, Holden S, et al. 3D analysis of facial morphology. Am J Med Genet A. 2004;126A:339–48.CrossRefPubMed
32.
go back to reference Hammond P, Suttie M, Hennekam RC, Allanson J, Shore EM, Kaplan FS. The face signature of fibrodysplasia ossificans progressiva. Am J Med Genet A. 2012;158A:1368–80.CrossRefPubMedPubMedCentral Hammond P, Suttie M, Hennekam RC, Allanson J, Shore EM, Kaplan FS. The face signature of fibrodysplasia ossificans progressiva. Am J Med Genet A. 2012;158A:1368–80.CrossRefPubMedPubMedCentral
34.
go back to reference Farkas LG. Anthropometry of the Head and Face. New York: Raven Press; 1994. Farkas LG. Anthropometry of the Head and Face. New York: Raven Press; 1994.
35.
go back to reference Shi J, Samal A, Marx D. How effective are landmarks and their geometry for face recognition? Comput Vis Image Underst. 2006;102:117–33.CrossRef Shi J, Samal A, Marx D. How effective are landmarks and their geometry for face recognition? Comput Vis Image Underst. 2006;102:117–33.CrossRef
36.
go back to reference Bookstein FL. Morphometric Tools for Landmark Data: Geometry and Biology. Cambridge [England]. New York: Cambridge University Press; 1997. Bookstein FL. Morphometric Tools for Landmark Data: Geometry and Biology. Cambridge [England]. New York: Cambridge University Press; 1997.
37.
go back to reference Jobson DJ, Rahman Z, Woodell GA. Properties and performance of a center/surround retinex. IEEE Trans Image Process Publ IEEE Signal Process Soc. 1997;6:451–62.CrossRef Jobson DJ, Rahman Z, Woodell GA. Properties and performance of a center/surround retinex. IEEE Trans Image Process Publ IEEE Signal Process Soc. 1997;6:451–62.CrossRef
38.
go back to reference Jobson DJ, Rahman Z, Woodell GA. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process Publ IEEE Signal Process Soc. 1997;6:965–76.CrossRef Jobson DJ, Rahman Z, Woodell GA. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process Publ IEEE Signal Process Soc. 1997;6:965–76.CrossRef
39.
go back to reference Chen W, Meng Joo E, Shiqian W. Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans Syst Man Cybern Part B Cybern. 2006;36:458–66.CrossRef Chen W, Meng Joo E, Shiqian W. Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans Syst Man Cybern Part B Cybern. 2006;36:458–66.CrossRef
40.
go back to reference Lee J, Muralidhar GS, Bovik AC, Fingeret MC, Markey MK. Correlation between structural and color changes in 3D facial images of head and neck cancer patients following reconstructive surgery. In: 26th Int Congr Exhib Comput Assist Radiol Surg. Pisa Italy: CARS; 2012. Lee J, Muralidhar GS, Bovik AC, Fingeret MC, Markey MK. Correlation between structural and color changes in 3D facial images of head and neck cancer patients following reconstructive surgery. In: 26th Int Congr Exhib Comput Assist Radiol Surg. Pisa Italy: CARS; 2012.
41.
go back to reference Pérez P, Gangnet M, Blake A. Poisson image editing. ACM Trans Graph. 2003;22:313–8.CrossRef Pérez P, Gangnet M, Blake A. Poisson image editing. ACM Trans Graph. 2003;22:313–8.CrossRef
42.
go back to reference Barrett R, Berry M, Chan TF, Demmel J, Donato J, Dongarra J, et al. Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods. 2nd ed. Philadelphia, PA: SIAM; 1994.CrossRef Barrett R, Berry M, Chan TF, Demmel J, Donato J, Dongarra J, et al. Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods. 2nd ed. Philadelphia, PA: SIAM; 1994.CrossRef
43.
go back to reference Giachetti A, Mazzi E, Piscitelli F, Aono M, Hamza AB, Bonis T, et al. SHREC’14 Track: Automatic Location of Landmarks used in Manual Anthropometry. In: Eurographics Workshop on 3D Object Retrieval. 2014. p. 93–100. Giachetti A, Mazzi E, Piscitelli F, Aono M, Hamza AB, Bonis T, et al. SHREC’14 Track: Automatic Location of Landmarks used in Manual Anthropometry. In: Eurographics Workshop on 3D Object Retrieval. 2014. p. 93–100.
44.
go back to reference Gardiner MD, Topps A, Richardson G, Sacker A, Clarke A, Butler PEM. Differential judgements about disfigurement: the role of location, age and gender in decisions made by observers. J Plast Reconstr Aesthetic Surg JPRAS. 2010;63:73–7.CrossRef Gardiner MD, Topps A, Richardson G, Sacker A, Clarke A, Butler PEM. Differential judgements about disfigurement: the role of location, age and gender in decisions made by observers. J Plast Reconstr Aesthetic Surg JPRAS. 2010;63:73–7.CrossRef
45.
go back to reference Christensen RHB. Ordinal—Regression Models for Ordinal Data. 2013. R package version 22 (2010). Christensen RHB. Ordinal—Regression Models for Ordinal Data. 2013. R package version 22 (2010).
Metadata
Title
Eigen-disfigurement model for simulating plausible facial disfigurement after reconstructive surgery
Authors
Juhun Lee
Michelle C Fingeret
Alan C Bovik
Gregory P Reece
Roman J Skoracki
Matthew M Hanasono
Mia K Markey
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Imaging / Issue 1/2015
Electronic ISSN: 1471-2342
DOI
https://doi.org/10.1186/s12880-015-0050-7

Other articles of this Issue 1/2015

BMC Medical Imaging 1/2015 Go to the issue