Skip to main content
Top
Published in: Trials 1/2020

Open Access 01-12-2020 | Research

Evaluating the re-identification risk of a clinical study report anonymized under EMA Policy 0070 and Health Canada Regulations

Authors: Janice Branson, Nathan Good, Jung-Wei Chen, Will Monge, Christian Probst, Khaled El Emam

Published in: Trials | Issue 1/2020

Login to get access

Abstract

Background

Regulatory agencies, such as the European Medicines Agency and Health Canada, are requiring the public sharing of clinical trial reports that are used to make drug approval decisions. Both agencies have provided guidance for the quantitative anonymization of these clinical reports before they are shared. There is limited empirical information on the effectiveness of this approach in protecting patient privacy for clinical trial data.

Methods

In this paper we empirically test the hypothesis that when these guidelines are implemented in practice, they provide adequate privacy protection to patients. An anonymized clinical study report for a trial on a non-steroidal anti-inflammatory drug that is sold as a prescription eye drop was subjected to re-identification. The target was 500 patients in the USA. Only suspected matches to real identities were reported.

Results

Six suspected matches with low confidence scores were identified. Each suspected match took 24.2 h of effort. Social media and death records provided the most useful information for getting the suspected matches.

Conclusions

These results suggest that the anonymization guidance from these agencies can provide adequate privacy protection for patients, and the modes of attack can inform further refinements of the methodologies they recommend in their guidance for manufacturers.
Appendix
Available only for authorised users
Literature
3.
go back to reference International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use. Organisation of the common technical document for the registration of pharmaceuticals for human use: M4. Geneva: ICH; 2016. International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use. Organisation of the common technical document for the registration of pharmaceuticals for human use: M4. Geneva: ICH; 2016.
4.
go back to reference International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. Structure and content of clinical study reports: E3. Geneva: ICH; 1995. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. Structure and content of clinical study reports: E3. Geneva: ICH; 1995.
5.
go back to reference European Medicines Agency. European Medicines Agency policy on publication of data for medicinal products for human use: policy 0070. 2014. European Medicines Agency. European Medicines Agency policy on publication of data for medicinal products for human use: policy 0070. 2014.
7.
go back to reference Ferran J-M, Nevitt S. European Medicines Agency policy 0070: an exploratory review of data utility in clinical study reports for research. BMC Med Res Methodol. 2019;19(1):204.CrossRefPubMedPubMedCentral Ferran J-M, Nevitt S. European Medicines Agency policy 0070: an exploratory review of data utility in clinical study reports for research. BMC Med Res Methodol. 2019;19(1):204.CrossRefPubMedPubMedCentral
8.
go back to reference Hundepool A, et al. Statistical disclosure control. Chichester: Wiley; 2012. Hundepool A, et al. Statistical disclosure control. Chichester: Wiley; 2012.
9.
go back to reference Willenborg L, de Waal T. Statistical disclosure control in practice. New York: Springer-Verlag; 1996.CrossRef Willenborg L, de Waal T. Statistical disclosure control in practice. New York: Springer-Verlag; 1996.CrossRef
10.
go back to reference Willenborg L, de Waal T. Elements of statistical disclosure control. New York: Springer-Verlag; 2001.CrossRef Willenborg L, de Waal T. Elements of statistical disclosure control. New York: Springer-Verlag; 2001.CrossRef
12.
go back to reference European Medicines Agency, “External guidance on the implementation of the European Medicines Agency policy on the publication of clinical data for medicinal products for human use (v1.4),” 2018. European Medicines Agency, “External guidance on the implementation of the European Medicines Agency policy on the publication of clinical data for medicinal products for human use (v1.4),” 2018.
13.
go back to reference El Emam K. Guide to the de-identification of personal health information. Auerbach: CRC Press; 2013.CrossRef El Emam K. Guide to the de-identification of personal health information. Auerbach: CRC Press; 2013.CrossRef
14.
go back to reference Duncan G, Elliot M, Salazar G. Statistical confidentiality—principles and practice. Boca Raton: Springer; 2011. Duncan G, Elliot M, Salazar G. Statistical confidentiality—principles and practice. Boca Raton: Springer; 2011.
16.
go back to reference Doyle P, Lane J, Theeuwes J, Zayatz L, editors. Confidentiality, disclosure and data access: theory and practical applications for statistical agencies. 1st ed. Amsterdam, New York: Elsevier Science; 2001. Doyle P, Lane J, Theeuwes J, Zayatz L, editors. Confidentiality, disclosure and data access: theory and practical applications for statistical agencies. 1st ed. Amsterdam, New York: Elsevier Science; 2001.
17.
go back to reference European Medicines Agency. Clinical data publication in numbers. In: EMA Technical Anonymization Group (TAG) meeting; 2018. European Medicines Agency. Clinical data publication in numbers. In: EMA Technical Anonymization Group (TAG) meeting; 2018.
18.
go back to reference Multi-Regional Clinical Trials Center and European Medicines Agency. Data anonymisation—a key enabler for clinical data sharing: workshop report. London: European Medicines Agency; 2018. Multi-Regional Clinical Trials Center and European Medicines Agency. Data anonymisation—a key enabler for clinical data sharing: workshop report. London: European Medicines Agency; 2018.
19.
go back to reference Information Commissioner’s Office. Anonymisation: managing data protection risk code of practice. Wilmslow: Information Commissioner’s Office; 2012. Information Commissioner’s Office. Anonymisation: managing data protection risk code of practice. Wilmslow: Information Commissioner’s Office; 2012.
21.
go back to reference Elliot M, Mackey E, O’Hara K, Tudor C. Anonymisation decision-making framework. Manchester: UKAN Publications; 2016. Elliot M, Mackey E, O’Hara K, Tudor C. Anonymisation decision-making framework. Manchester: UKAN Publications; 2016.
24.
go back to reference Elliot MJ, Purdam K. The evaluation of risk from identification attempts. Manchester: University of Manchester; 2003. Elliot MJ, Purdam K. The evaluation of risk from identification attempts. Manchester: University of Manchester; 2003.
25.
go back to reference Kwok P, Davern M, Hair E, Lafky D. Harder than you think: a case study of re-identification risk of HIPAA-compliant records. In: JSM proceedings, Miami Beach, FL; 2011. Kwok P, Davern M, Hair E, Lafky D. Harder than you think: a case study of re-identification risk of HIPAA-compliant records. In: JSM proceedings, Miami Beach, FL; 2011.
26.
go back to reference Lafky D. The safe harbor method of de-identification: an empirical test. In: Presented at the fourth national HIPAA Summit West, San Francisco, CA; 2009. Lafky D. The safe harbor method of de-identification: an empirical test. In: Presented at the fourth national HIPAA Summit West, San Francisco, CA; 2009.
27.
go back to reference Elliot M. Using targeted perturbation of microdata to protect against intelligent linkage. In: Proceedings of UNECE work session on statistical confidentiality, Manchester, UK; 2007. Elliot M. Using targeted perturbation of microdata to protect against intelligent linkage. In: Proceedings of UNECE work session on statistical confidentiality, Manchester, UK; 2007.
28.
go back to reference Elliot M. Report on the disclosure risk analysis of the supporting people datasets Manchester: Administrative Data Liaison Service; 2011. Elliot M. Report on the disclosure risk analysis of the supporting people datasets Manchester: Administrative Data Liaison Service; 2011.
30.
go back to reference Tudor C, Cornish G, Spicer K. Intruder testing on the 2011 UK Census: providing practical evidence for disclosure protection. J Privacy Confidentiality. 2013;5(2):111–32. Tudor C, Cornish G, Spicer K. Intruder testing on the 2011 UK Census: providing practical evidence for disclosure protection. J Privacy Confidentiality. 2013;5(2):111–32.
31.
go back to reference Spicer K, Tudor C, Cornish G. Intruder testing: demonstrating practical evidence of disclosure protection in 2011 UK Census. In: Presented at the UNECE conference of European statisticians, Ottawa, ON; 2013. Spicer K, Tudor C, Cornish G. Intruder testing: demonstrating practical evidence of disclosure protection in 2011 UK Census. In: Presented at the UNECE conference of European statisticians, Ottawa, ON; 2013.
32.
go back to reference Gregory M. DECC’s national energy efficiency data-framework—anonymised dataset; 2014. Gregory M. DECC’s national energy efficiency data-framework—anonymised dataset; 2014.
35.
go back to reference Narayanan A. An adversarial analysis of the reidentifiability of the heritage health prize dataset; 2011. Narayanan A. An adversarial analysis of the reidentifiability of the heritage health prize dataset; 2011.
36.
go back to reference Li M, Scaiano M, El Emam K, Malin B. Efficient active learning for electronic medical record de-identification. AMIA Jt Summits Transl Sci Proc. 2019;2019:462-71. Li M, Scaiano M, El Emam K, Malin B. Efficient active learning for electronic medical record de-identification. AMIA Jt Summits Transl Sci Proc. 2019;2019:462-71.
37.
go back to reference El Emam K, Arbuckle L. Anonymizing health data: case studies and methods to get you started. Sabastopol: O’Reilly; 2013. El Emam K, Arbuckle L. Anonymizing health data: case studies and methods to get you started. Sabastopol: O’Reilly; 2013.
39.
go back to reference El Emam K, Paton D, Dankar F, Koru G. De-identifying a public use microdata file from the Canadian national discharge abstract database. BMC Med Inform Decis Mak. 2011;11:53.CrossRefPubMedPubMedCentral El Emam K, Paton D, Dankar F, Koru G. De-identifying a public use microdata file from the Canadian national discharge abstract database. BMC Med Inform Decis Mak. 2011;11:53.CrossRefPubMedPubMedCentral
43.
go back to reference Sweeney L. k-anonymity: a model for protecting privacy. Int J Uncertain Fuzz Knowl Based Syst. 2002;10(5):557–70.CrossRef Sweeney L. k-anonymity: a model for protecting privacy. Int J Uncertain Fuzz Knowl Based Syst. 2002;10(5):557–70.CrossRef
45.
go back to reference Sweeney L. Matching known patients to health records in Washington State data. Cambridge: Harvard University. Data Privacy Lab; 2013. Sweeney L. Matching known patients to health records in Washington State data. Cambridge: Harvard University. Data Privacy Lab; 2013.
48.
go back to reference European Medicines Agency, “Data anonymisation—a key enabler for clinical data sharing: workshop report,” 2017. European Medicines Agency, “Data anonymisation—a key enabler for clinical data sharing: workshop report,” 2017.
Metadata
Title
Evaluating the re-identification risk of a clinical study report anonymized under EMA Policy 0070 and Health Canada Regulations
Authors
Janice Branson
Nathan Good
Jung-Wei Chen
Will Monge
Christian Probst
Khaled El Emam
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Trials / Issue 1/2020
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-020-4120-y

Other articles of this Issue 1/2020

Trials 1/2020 Go to the issue