Skip to main content
Top
Published in: Journal of Digital Imaging 2/2017

01-04-2017

Automated Facial Recognition of Computed Tomography-Derived Facial Images: Patient Privacy Implications

Authors: Connie L. Parks, Keith L. Monson

Published in: Journal of Imaging Informatics in Medicine | Issue 2/2017

Login to get access

Abstract

The recognizability of facial images extracted from publically available medical scans raises patient privacy concerns. This study examined how accurately facial images extracted from computed tomography (CT) scans are objectively matched with corresponding photographs of the scanned individuals. The test subjects were 128 adult Americans ranging in age from 18 to 60 years, representing both sexes and three self-identified population (ancestral descent) groups (African, European, and Hispanic). Using facial recognition software, the 2D images of the extracted facial models were compared for matches against five differently sized photo galleries. Depending on the scanning protocol and gallery size, in 6–61 % of the cases, a correct life photo match for a CT-derived facial image was the top ranked image in the generated candidate lists, even when blind searching in excess of 100,000 images. In 31–91 % of the cases, a correct match was located within the top 50 images. Few significant differences (p > 0.05) in match rates were observed between the sexes or across the three age cohorts. Highly significant differences (p < 0.01) were, however, observed across the three ancestral cohorts and between the two CT scanning protocols. Results suggest that the probability of a match between a facial image extracted from a medical scan and a photograph of the individual is moderately high. The facial image data inherent in commonly employed medical imaging modalities may need to consider a potentially identifiable form of “comparable” facial imagery and protected as such under patient privacy legislation.
Literature
1.
go back to reference Smith-Bindman R, Miglioretti DL, Johnson E, Lee C, Feigelson HS, Flynn M, Greenlee RT, Kruger RL, Hornbrook MC, Roblin D, Solberg LI, Vanneman N, Weinmann S, Williams AE: Use of diagnostic imaging studies and associated radiation exposure for patients enrolled in large integrated health care systems, 1996-2010. JAMA 07(22):2400–2409, 2012 Smith-Bindman R, Miglioretti DL, Johnson E, Lee C, Feigelson HS, Flynn M, Greenlee RT, Kruger RL, Hornbrook MC, Roblin D, Solberg LI, Vanneman N, Weinmann S, Williams AE: Use of diagnostic imaging studies and associated radiation exposure for patients enrolled in large integrated health care systems, 1996-2010. JAMA 07(22):2400–2409, 2012
2.
go back to reference Rao VM, Levin DC, Parker L, Frangos AJ, Sunshine JH: Trends in utilization rates of the various imaging modalities in emergency departments: Nationwide Medicare data from 2000 to 2008. J Am Coll Radiol 8(10):706–709, 2011CrossRefPubMed Rao VM, Levin DC, Parker L, Frangos AJ, Sunshine JH: Trends in utilization rates of the various imaging modalities in emergency departments: Nationwide Medicare data from 2000 to 2008. J Am Coll Radiol 8(10):706–709, 2011CrossRefPubMed
3.
go back to reference Agarwal R, Bergey M, Sonnad S, Butowsky H, Bhargavan M, Bleshman MH: Inpatient CT and MRI utilization: trends in the academic hospital setting. J Am Coll Radiol 7(12):949–955. 2010CrossRefPubMed Agarwal R, Bergey M, Sonnad S, Butowsky H, Bhargavan M, Bleshman MH: Inpatient CT and MRI utilization: trends in the academic hospital setting. J Am Coll Radiol 7(12):949–955. 2010CrossRefPubMed
4.
go back to reference Broder J, Warshauer DM: Increasing utilization of computed tomography in the adult emergency department, 2000–2005. Emerg Radio 13(1):25–30. 2006CrossRef Broder J, Warshauer DM: Increasing utilization of computed tomography in the adult emergency department, 2000–2005. Emerg Radio 13(1):25–30. 2006CrossRef
5.
go back to reference Brenner DJ, Hall EJ: Computed tomography—an increasing source of radiation exposure. N Engl J Med 357(22):2277–2284. 2007CrossRefPubMed Brenner DJ, Hall EJ: Computed tomography—an increasing source of radiation exposure. N Engl J Med 357(22):2277–2284. 2007CrossRefPubMed
7.
go back to reference Peddicord D, Waldo AB, Boutin M, Grande T, Gutierrez L Jr: A proposal to protect privacy of health information while accelerating comparative effectiveness research. Health Aff (Milwood) 29(11):2082–2090. 2010CrossRef Peddicord D, Waldo AB, Boutin M, Grande T, Gutierrez L Jr: A proposal to protect privacy of health information while accelerating comparative effectiveness research. Health Aff (Milwood) 29(11):2082–2090. 2010CrossRef
8.
go back to reference Budin F, Zeng D, Ghosh A, Bullitt E: Preventing facial recognition when rendering MR images of the head in three dimensions. Med Image Anal 12(3):229–239. 2008CrossRefPubMed Budin F, Zeng D, Ghosh A, Bullitt E: Preventing facial recognition when rendering MR images of the head in three dimensions. Med Image Anal 12(3):229–239. 2008CrossRefPubMed
9.
go back to reference Noumeir R, Lemay A, Lina JM: Pseudonymization of radiology data for research purposes. J Digit Imaging 20(3):284–295. 2007CrossRefPubMed Noumeir R, Lemay A, Lina JM: Pseudonymization of radiology data for research purposes. J Digit Imaging 20(3):284–295. 2007CrossRefPubMed
10.
go back to reference P.L. No. 104–191, 110 Stat. 1938 (1996). United States Department of Health and Human Services. The Health Insurance Portability and Accountability Act (HIPAA) P.L. No. 104–191, 110 Stat. 1938 (1996). United States Department of Health and Human Services. The Health Insurance Portability and Accountability Act (HIPAA)
11.
go back to reference 11. C.F.R. § 164.514(e) (2). US Department of Health and Human Services. Privacy of Individually Identifiable Health Information. Other requirements relating to uses and disclosures of protected health information 11. C.F.R. § 164.514(e) (2). US Department of Health and Human Services. Privacy of Individually Identifiable Health Information. Other requirements relating to uses and disclosures of protected health information
12.
go back to reference Fetzer DT, West OC: The HIPAA privacy rule and protected health information: implications in research involving DICOM image databases. Acad Radiol 15(3):390–395. 2008CrossRefPubMed Fetzer DT, West OC: The HIPAA privacy rule and protected health information: implications in research involving DICOM image databases. Acad Radiol 15(3):390–395. 2008CrossRefPubMed
13.
14.
go back to reference Maal TJJ, Plooij JM, Rangel, FA Mollemans W, Schutyser FAC, Bergé SJ: The accuracy of matching three-dimensional photographs with skin surfaces derived from cone-beam computed tomography. Int J Oral Maxillofac Surg 37(7):641–646. 2008CrossRefPubMed Maal TJJ, Plooij JM, Rangel, FA Mollemans W, Schutyser FAC, Bergé SJ: The accuracy of matching three-dimensional photographs with skin surfaces derived from cone-beam computed tomography. Int J Oral Maxillofac Surg 37(7):641–646. 2008CrossRefPubMed
15.
go back to reference Jen-Sho Chen J, Juluru K, Morgan T, Moffitt R, Siddiqui KM, Siegel EL: Implications of surface-rendered facial CT images in patient privacy. Am J Roentgenol 202(6):1267–1271. 2014CrossRef Jen-Sho Chen J, Juluru K, Morgan T, Moffitt R, Siddiqui KM, Siegel EL: Implications of surface-rendered facial CT images in patient privacy. Am J Roentgenol 202(6):1267–1271. 2014CrossRef
19.
go back to reference Prior FW, Brunsden B, Hildebolt C, Nolan TS, Pringle M, Vaishnavi SN, Larson-Prior LJ: Facial recognition from volume-rendered magnetic resonance imaging data. IEEE Trans Inf Technol Biomed 13(1):5–9. 2009CrossRefPubMed Prior FW, Brunsden B, Hildebolt C, Nolan TS, Pringle M, Vaishnavi SN, Larson-Prior LJ: Facial recognition from volume-rendered magnetic resonance imaging data. IEEE Trans Inf Technol Biomed 13(1):5–9. 2009CrossRefPubMed
20.
go back to reference Mazura JC, Julura K, Chen JJ, Morgan TA, John M, Siegel EL: Facial recognition software success rates for the identification of 3D surface reconstructed facial images: implications for patient privacy and security. J Digit Imaging 25(3):347–351. 2012CrossRefPubMed Mazura JC, Julura K, Chen JJ, Morgan TA, John M, Siegel EL: Facial recognition software success rates for the identification of 3D surface reconstructed facial images: implications for patient privacy and security. J Digit Imaging 25(3):347–351. 2012CrossRefPubMed
21.
go back to reference Hwang HG, Han HE, Kuo KM, Liu CF: The differing privacy concerns regarding exchanging electronic medical records of internet users in Taiwan. J Med Syst 36(6):3783–93. 2012CrossRefPubMed Hwang HG, Han HE, Kuo KM, Liu CF: The differing privacy concerns regarding exchanging electronic medical records of internet users in Taiwan. J Med Syst 36(6):3783–93. 2012CrossRefPubMed
22.
go back to reference Senior A, Pankanti S: Privacy protection and face recognition. In: Li, SZ and Jain, AK, eds: Handbook of face recognition, 2nd ed, NY: Springer, pp 671–691. 2011CrossRef Senior A, Pankanti S: Privacy protection and face recognition. In: Li, SZ and Jain, AK, eds: Handbook of face recognition, 2nd ed, NY: Springer, pp 671–691. 2011CrossRef
26.
go back to reference Parks CP, Richard H, Monson KL: Preliminary performance assessment of computer automated facial approximations using computed tomography scans of living individuals. Forensic Sci Int 233(1–3):133–139. 2013CrossRefPubMed Parks CP, Richard H, Monson KL: Preliminary performance assessment of computer automated facial approximations using computed tomography scans of living individuals. Forensic Sci Int 233(1–3):133–139. 2013CrossRefPubMed
29.
go back to reference Parks CL, Monson KL: Recognizability of ReFace facial approximations in an automated facial recognition context for potential application in unidentified persons data repositories. Part I: Optimally modeled conditions. Forensic Sci Int (in review) Parks CL, Monson KL: Recognizability of ReFace facial approximations in an automated facial recognition context for potential application in unidentified persons data repositories. Part I: Optimally modeled conditions. Forensic Sci Int (in review)
30.
go back to reference Parks CL, Monson KL: Recognizability of ReFace facial approximations in an automated facial recognition context for potential application in unidentified persons data repositories. Part II: Operationally modeled conditions. Forensic Sci Int (in review) Parks CL, Monson KL: Recognizability of ReFace facial approximations in an automated facial recognition context for potential application in unidentified persons data repositories. Part II: Operationally modeled conditions. Forensic Sci Int (in review)
31.
go back to reference P.J. Phillips, P. Grother, R. Michaels: Evaluation methods in face recognition. In: Li, SZ and Jain, AK, eds: Handbook of face recognition, 2nd ed, NY: Springer, pp 551–574. 2011.CrossRef P.J. Phillips, P. Grother, R. Michaels: Evaluation methods in face recognition. In: Li, SZ and Jain, AK, eds: Handbook of face recognition, 2nd ed, NY: Springer, pp 551–574. 2011.CrossRef
32.
go back to reference Jain, AK and Ross, AA: Introduction to biometrics. In: Jain, AK, Flynn, P and Ross, AA, eds: Handbook of biometrics, NY: Springer, pp 1–22. 2008CrossRef Jain, AK and Ross, AA: Introduction to biometrics. In: Jain, AK, Flynn, P and Ross, AA, eds: Handbook of biometrics, NY: Springer, pp 1–22. 2008CrossRef
36.
go back to reference Holm S: A simple sequentially rejective multiple test procedure. Scand J Statistics 6(2):65–70. 1979 Holm S: A simple sequentially rejective multiple test procedure. Scand J Statistics 6(2):65–70. 1979
Metadata
Title
Automated Facial Recognition of Computed Tomography-Derived Facial Images: Patient Privacy Implications
Authors
Connie L. Parks
Keith L. Monson
Publication date
01-04-2017
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 2/2017
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-016-9932-7

Other articles of this Issue 2/2017

Journal of Digital Imaging 2/2017 Go to the issue