Skip to main content
Top
Published in: Drug Safety 4/2017

Open Access 01-04-2017 | Original Research Article

Evaluation of Facebook and Twitter Monitoring to Detect Safety Signals for Medical Products: An Analysis of Recent FDA Safety Alerts

Authors: Carrie E. Pierce, Khaled Bouri, Carol Pamer, Scott Proestel, Harold W. Rodriguez, Hoa Van Le, Clark C. Freifeld, John S. Brownstein, Mark Walderhaug, I. Ralph Edwards, Nabarun Dasgupta

Published in: Drug Safety | Issue 4/2017

Login to get access

Abstract

Introduction

The rapid expansion of the Internet and computing power in recent years has opened up the possibility of using social media for pharmacovigilance. While this general concept has been proposed by many, central questions remain as to whether social media can provide earlier warnings for rare and serious events than traditional signal detection from spontaneous report data.

Objective

Our objective was to examine whether specific product–adverse event pairs were reported via social media before being reported to the US FDA Adverse Event Reporting System (FAERS).

Methods

A retrospective analysis of public Facebook and Twitter data was conducted for 10 recent FDA postmarketing safety signals at the drug–event pair level with six negative controls. Social media data corresponding to two years prior to signal detection of each product–event pair were compiled. Automated classifiers were used to identify each ‘post with resemblance to an adverse event’ (Proto-AE), among English language posts. A custom dictionary was used to translate Internet vernacular into Medical Dictionary for Regulatory Activities (MedDRA®) Preferred Terms. Drug safety physicians conducted a manual review to determine causality using World Health Organization-Uppsala Monitoring Centre (WHO-UMC) assessment criteria. Cases were also compared with those reported in FAERS.

Findings

A total of 935,246 posts were harvested from Facebook and Twitter, from March 2009 through October 2014. The automated classifier identified 98,252 Proto-AEs. Of these, 13 posts were selected for causality assessment of product–event pairs. Clinical assessment revealed that posts had sufficient information to warrant further investigation for two possible product–event associations: dronedarone–vasculitis and Banana Boat Sunscreen--skin burns. No product–event associations were found among the negative controls. In one of the positive cases, the first report occurred in social media prior to signal detection from FAERS, whereas the other case occurred first in FAERS.

Conclusions

An efficient semi-automated approach to social media monitoring may provide earlier insights into certain adverse events. More work is needed to elaborate additional uses for social media data in pharmacovigilance and to determine how they can be applied by regulatory agencies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Deyo R. Gaps, tensions, and conflicts in the FDA approval process: implications for clinical practice. J Am Board Fam Med. 2004;17(2):142–9.CrossRef Deyo R. Gaps, tensions, and conflicts in the FDA approval process: implications for clinical practice. J Am Board Fam Med. 2004;17(2):142–9.CrossRef
2.
go back to reference Smith CC, Bennet PM, Pearce HM, et al. Adverse drug reactions in a hospital general medical unit meriting notification to the Committee on Safety of Medicines. Br J Clin Pharmacol. 1996;42:423–9.CrossRefPubMedPubMedCentral Smith CC, Bennet PM, Pearce HM, et al. Adverse drug reactions in a hospital general medical unit meriting notification to the Committee on Safety of Medicines. Br J Clin Pharmacol. 1996;42:423–9.CrossRefPubMedPubMedCentral
3.
go back to reference Brownstein JS, Freifeld CC, Madoff LC. Digital disease detection—harnessing the Web for public health surveillance. N Engl J Med. 2009;360(21):2153–7. doi:10.1056/NEJMp0900702. Brownstein JS, Freifeld CC, Madoff LC. Digital disease detection—harnessing the Web for public health surveillance. N Engl J Med. 2009;360(21):2153–7. doi:10.​1056/​NEJMp0900702.
7.
go back to reference Ghosh R, Lewis D. Aims and approaches of Web-RADR: a consortium ensuring reliable ADR reporting via mobile devices and new insights from social media. Expert Opin Drug Saf. 2015;14(12):1845–53.CrossRefPubMed Ghosh R, Lewis D. Aims and approaches of Web-RADR: a consortium ensuring reliable ADR reporting via mobile devices and new insights from social media. Expert Opin Drug Saf. 2015;14(12):1845–53.CrossRefPubMed
8.
go back to reference Golder S, Norman G, Loke YK. Systematic review on the prevalence, frequency and comparative value of adverse events data in social media. Br J Clin Pharmacol. 2015;80(4):878–88.CrossRefPubMedPubMedCentral Golder S, Norman G, Loke YK. Systematic review on the prevalence, frequency and comparative value of adverse events data in social media. Br J Clin Pharmacol. 2015;80(4):878–88.CrossRefPubMedPubMedCentral
9.
go back to reference Lardon J1, Abdellaoui R, Bellet F, Asfari H, Souvignet J, Texier N, Jaulent M-C, Beyens M-N, Burgun A, Bousquet C. Adverse drug reaction identification and extraction in social media: a scoping review. J Med Internet Res. 2015;17(7):e171.CrossRefPubMedPubMedCentral Lardon J1, Abdellaoui R, Bellet F, Asfari H, Souvignet J, Texier N, Jaulent M-C, Beyens M-N, Burgun A, Bousquet C. Adverse drug reaction identification and extraction in social media: a scoping review. J Med Internet Res. 2015;17(7):e171.CrossRefPubMedPubMedCentral
10.
go back to reference Sloane R, Osanlou O, Lewis D, Bollegala D, Maskell S, Pirmohamed M. Social media and pharmacovigilance: a review of the opportunities and challenges. Br J Clin Pharmacol. 2015;80(4):910–20.CrossRefPubMedPubMedCentral Sloane R, Osanlou O, Lewis D, Bollegala D, Maskell S, Pirmohamed M. Social media and pharmacovigilance: a review of the opportunities and challenges. Br J Clin Pharmacol. 2015;80(4):910–20.CrossRefPubMedPubMedCentral
11.
go back to reference Sarker A, Ginn R, Nikfarjam A, O’Connor K, Smith K, Jayaraman S, Upadhaya T, Gonzalez G. Utilizing social media data for pharmacovigilance: a review. J Biomed Inform. 2015;54:202–12.CrossRefPubMedPubMedCentral Sarker A, Ginn R, Nikfarjam A, O’Connor K, Smith K, Jayaraman S, Upadhaya T, Gonzalez G. Utilizing social media data for pharmacovigilance: a review. J Biomed Inform. 2015;54:202–12.CrossRefPubMedPubMedCentral
12.
go back to reference Norén GN. Pharmacovigilance for a revolving world: prospects of patient-generated data on the internet. Drug Saf. 2014;37(10):761–4.CrossRefPubMed Norén GN. Pharmacovigilance for a revolving world: prospects of patient-generated data on the internet. Drug Saf. 2014;37(10):761–4.CrossRefPubMed
13.
go back to reference White RW, Harpaz R, Shah NH, DuMouchel W, Horvitz E. Toward enhanced pharmacovigilance using patient-generated data on the internet. Clin Pharmacol Ther. 2014;96(2):239–46.CrossRefPubMedPubMedCentral White RW, Harpaz R, Shah NH, DuMouchel W, Horvitz E. Toward enhanced pharmacovigilance using patient-generated data on the internet. Clin Pharmacol Ther. 2014;96(2):239–46.CrossRefPubMedPubMedCentral
14.
go back to reference Masoni M, Guelfi MR, Conti A, Gensini GF. Pharmacovigilance and use of online health information. Trends Pharmacol Sci. 2013;34(7):357–8.CrossRefPubMed Masoni M, Guelfi MR, Conti A, Gensini GF. Pharmacovigilance and use of online health information. Trends Pharmacol Sci. 2013;34(7):357–8.CrossRefPubMed
16.
go back to reference Yamamoto M, Kubota K, Okazaki M, Dobashi A, Hashguchi M, Doil H, et al. Patients views and experiences in online reporting adverse drug reactions: findings of a national pilot study in Japan. Patient Prefer Adher. 2015;9:173–84. doi:10.2147/PPA.S75761.CrossRef Yamamoto M, Kubota K, Okazaki M, Dobashi A, Hashguchi M, Doil H, et al. Patients views and experiences in online reporting adverse drug reactions: findings of a national pilot study in Japan. Patient Prefer Adher. 2015;9:173–84. doi:10.​2147/​PPA.​S75761.CrossRef
17.
go back to reference Abou Taam M, Rossard C, Cantaloube L, Bouscaren N, Roche G, Pochard L, et al. Analysis of patients’ narratives posted on social media websites on benfluorex’s (Mediator(R)) withdrawal in France. J Clin Pharm Ther. 2014;39(1):53–5.CrossRefPubMed Abou Taam M, Rossard C, Cantaloube L, Bouscaren N, Roche G, Pochard L, et al. Analysis of patients’ narratives posted on social media websites on benfluorex’s (Mediator(R)) withdrawal in France. J Clin Pharm Ther. 2014;39(1):53–5.CrossRefPubMed
18.
go back to reference Dyar OJ, Castro-Sanchez E, Holmes AH. What makes people talk about antibiotics on social media? A retrospective analysis of Twitter use. J Antimicrob Chemother. 2014;69(9):2568–72.CrossRefPubMedPubMedCentral Dyar OJ, Castro-Sanchez E, Holmes AH. What makes people talk about antibiotics on social media? A retrospective analysis of Twitter use. J Antimicrob Chemother. 2014;69(9):2568–72.CrossRefPubMedPubMedCentral
19.
go back to reference Coloma PM, Becker B, Sturkenboom MC, van Mulligen EM, Kors JA. Evaluating social media networks in medicines safety surveillance: two case studies. Drug Saf. 2015;38(10):921–30.CrossRefPubMedPubMedCentral Coloma PM, Becker B, Sturkenboom MC, van Mulligen EM, Kors JA. Evaluating social media networks in medicines safety surveillance: two case studies. Drug Saf. 2015;38(10):921–30.CrossRefPubMedPubMedCentral
20.
go back to reference Pages A, Bondon-Guitton E, Montastruc JL, Bagheri H. Undesirable effects related to oral antineoplastic drugs: comparison between patients’ internet narratives and a national pharmacovigilance database. Drug Saf. 2014;37(8):629–37. doi:10.1007/s40264-014-0203-6.CrossRefPubMed Pages A, Bondon-Guitton E, Montastruc JL, Bagheri H. Undesirable effects related to oral antineoplastic drugs: comparison between patients’ internet narratives and a national pharmacovigilance database. Drug Saf. 2014;37(8):629–37. doi:10.​1007/​s40264-014-0203-6.CrossRefPubMed
21.
go back to reference Harmark L, van Puijenbroek E, van Grootheest K. Intensive monitoring of duloxetine: results of a web-based intensive monitoring study. Eur J Clin Pharmacol. 2013;69(2):209–15.CrossRefPubMed Harmark L, van Puijenbroek E, van Grootheest K. Intensive monitoring of duloxetine: results of a web-based intensive monitoring study. Eur J Clin Pharmacol. 2013;69(2):209–15.CrossRefPubMed
22.
go back to reference Schroder S, Zollner YF, Schaefer M. Drug related problems with Antiparkinsonian agents: consumer Internet reports versus published data. Pharmacoepidemiol Drug Saf. 2007;16(10):1161–6.CrossRefPubMed Schroder S, Zollner YF, Schaefer M. Drug related problems with Antiparkinsonian agents: consumer Internet reports versus published data. Pharmacoepidemiol Drug Saf. 2007;16(10):1161–6.CrossRefPubMed
23.
go back to reference Shutler L, Nelson LS, Portelli I, Blachford C, Perrone J. Drug use in the Twittersphere: a qualitative contextual analysis of tweets about prescription drugs. J Addict Dis. 2015;34(4):303–10.CrossRefPubMed Shutler L, Nelson LS, Portelli I, Blachford C, Perrone J. Drug use in the Twittersphere: a qualitative contextual analysis of tweets about prescription drugs. J Addict Dis. 2015;34(4):303–10.CrossRefPubMed
24.
go back to reference Simmering J, Polgreen LA, Polgreen PM. Web search query volume as a measure of pharmaceutical utilization and changes in prescribing patterns. Res Soc Adm Policy. 2014;10(6):896–903.CrossRef Simmering J, Polgreen LA, Polgreen PM. Web search query volume as a measure of pharmaceutical utilization and changes in prescribing patterns. Res Soc Adm Policy. 2014;10(6):896–903.CrossRef
25.
go back to reference White RW, Wang S, Pant A, Harpaz R, Shukla P, Sun W, et al. Early identification of adverse drug reactions from search log data. J Biomed Inform. 2016;59:42–8.CrossRefPubMed White RW, Wang S, Pant A, Harpaz R, Shukla P, Sun W, et al. Early identification of adverse drug reactions from search log data. J Biomed Inform. 2016;59:42–8.CrossRefPubMed
26.
go back to reference Nikfarjam A, Sarker A, O’Connor K, Ginn R, Gonzalez G. Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features. J Am Med Inform Assoc. 2015;22(3):671–81. doi:10.1093/jamia/ocu041.PubMedPubMedCentral Nikfarjam A, Sarker A, O’Connor K, Ginn R, Gonzalez G. Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features. J Am Med Inform Assoc. 2015;22(3):671–81. doi:10.​1093/​jamia/​ocu041.PubMedPubMedCentral
27.
go back to reference Sarker A, Gonzalez G. Portable automatic text classification for adverse drug reaction detection via multi-corpus training. J Biomed Inform. 2015;53:196–207.CrossRefPubMed Sarker A, Gonzalez G. Portable automatic text classification for adverse drug reaction detection via multi-corpus training. J Biomed Inform. 2015;53:196–207.CrossRefPubMed
28.
go back to reference Sarntivijai S, Abernethy DR. Use of internet search logs to evaluate potential drug adverse events. Clin Pharmacol Ther. 2014;96(2):149–50.CrossRefPubMed Sarntivijai S, Abernethy DR. Use of internet search logs to evaluate potential drug adverse events. Clin Pharmacol Ther. 2014;96(2):149–50.CrossRefPubMed
29.
go back to reference Freifeld CC, Brownstein JS, Menone CM, Bao W, Filice R, Kass-Hout T, et al. Digital drug safety surveillance: monitoring pharmaceutical products in twitter. Drug Saf. 2014;37(5):343–50.CrossRefPubMedPubMedCentral Freifeld CC, Brownstein JS, Menone CM, Bao W, Filice R, Kass-Hout T, et al. Digital drug safety surveillance: monitoring pharmaceutical products in twitter. Drug Saf. 2014;37(5):343–50.CrossRefPubMedPubMedCentral
30.
go back to reference O’Connor K, Pimpalkhute P, Nikfarjam A, Ginn R, Smith KL, Gonzalez G. Pharmacovigilance on Twitter? Mining tweets for adverse drug reactions. AMIA Annu Symp Proc. 2014;2014:924–33.PubMedPubMedCentral O’Connor K, Pimpalkhute P, Nikfarjam A, Ginn R, Smith KL, Gonzalez G. Pharmacovigilance on Twitter? Mining tweets for adverse drug reactions. AMIA Annu Symp Proc. 2014;2014:924–33.PubMedPubMedCentral
31.
go back to reference Wu H, Fang H, Stanhope SJ. Exploiting online discussions to discover unrecognized drug side effects. Methods Inf Med. 2013;52(2):152–9.CrossRefPubMed Wu H, Fang H, Stanhope SJ. Exploiting online discussions to discover unrecognized drug side effects. Methods Inf Med. 2013;52(2):152–9.CrossRefPubMed
32.
go back to reference Azadeh N, Sarker A, O’Connor K, Ginn R, Gonzalez G. Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features. J Am Med Inform Assoc. 2015;22:671–81. doi:10.1093/jamia/ocu041. Azadeh N, Sarker A, O’Connor K, Ginn R, Gonzalez G. Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features. J Am Med Inform Assoc. 2015;22:671–81. doi:10.​1093/​jamia/​ocu041.
34.
go back to reference Kunac DL, Tatley MV, Seddon ME. A new web-based Medication Error Reporting Programme (MERP) to supplement pharmacovigilance in New Zealand—findings from a pilot study in primary care. NZ Med J. 2014;127(1401):69–81. Kunac DL, Tatley MV, Seddon ME. A new web-based Medication Error Reporting Programme (MERP) to supplement pharmacovigilance in New Zealand—findings from a pilot study in primary care. NZ Med J. 2014;127(1401):69–81.
35.
go back to reference Karimi S, Metke-Jimenez A, Kemp M, Wang C. Cadec: a corpus of adverse drug event annotations. J Biomed Inform. 2015;55:73–81.CrossRefPubMed Karimi S, Metke-Jimenez A, Kemp M, Wang C. Cadec: a corpus of adverse drug event annotations. J Biomed Inform. 2015;55:73–81.CrossRefPubMed
36.
go back to reference Benton A, Ungar L, Hill S, Hennessy S, Mao J, Chung A, et al. Identifying potential adverse effects using the web: a new approach to medical hypothesis generation. J Biomed Inform. 2011;44(6):989–96.CrossRefPubMedPubMedCentral Benton A, Ungar L, Hill S, Hennessy S, Mao J, Chung A, et al. Identifying potential adverse effects using the web: a new approach to medical hypothesis generation. J Biomed Inform. 2011;44(6):989–96.CrossRefPubMedPubMedCentral
37.
go back to reference Mao J, Chung A, Benton A, Hill S, Ungar L, Leonard CE, et al. Online discussion of drug side effects and discontinuation among breast cancer survivors. Pharmacoepidemiol Drug Saf. 2013;22(3):256–62.CrossRefPubMedPubMedCentral Mao J, Chung A, Benton A, Hill S, Ungar L, Leonard CE, et al. Online discussion of drug side effects and discontinuation among breast cancer survivors. Pharmacoepidemiol Drug Saf. 2013;22(3):256–62.CrossRefPubMedPubMedCentral
38.
go back to reference US Food and Drug Administration. Medical product safety information. Silver Spring: US FDA; 2016. US Food and Drug Administration. Medical product safety information. Silver Spring: US FDA; 2016.
39.
go back to reference Harpaz R, Odgers D, Gaskin G, DuMouchel W, Winnenburg R, Bodenreider O, et al. A time-indexed references tandard of adverse drug reactions. Scientific Data. 2014;43:1–10. Harpaz R, Odgers D, Gaskin G, DuMouchel W, Winnenburg R, Bodenreider O, et al. A time-indexed references tandard of adverse drug reactions. Scientific Data. 2014;43:1–10.
42.
go back to reference Powell G, Seifert H, Reblin T, Burstein P, Blowers J, Menius J, Painter JL, Thomas M, Pierce CE, Rodriguez HW, Brownstein JS, Freifeld CC, Bell HG, Dasgupta N. Social media listening for routine post-marketing safety surveillance. Drug Saf. 2016;39(5):443–54.CrossRefPubMed Powell G, Seifert H, Reblin T, Burstein P, Blowers J, Menius J, Painter JL, Thomas M, Pierce CE, Rodriguez HW, Brownstein JS, Freifeld CC, Bell HG, Dasgupta N. Social media listening for routine post-marketing safety surveillance. Drug Saf. 2016;39(5):443–54.CrossRefPubMed
43.
go back to reference Robinson G. A statistical approach to the spam problem. Linux J. 2003;107:3. Robinson G. A statistical approach to the spam problem. Linux J. 2003;107:3.
45.
go back to reference Calabrese LH, Molloy E, Berger J. Sorting out the risks in progressive multifocal leukoencephalopathy. Nat Rev Rheumatol. 2015;11(2):119–23.CrossRefPubMed Calabrese LH, Molloy E, Berger J. Sorting out the risks in progressive multifocal leukoencephalopathy. Nat Rev Rheumatol. 2015;11(2):119–23.CrossRefPubMed
46.
go back to reference Jones HB. The effects of sensual drugs on behavior: clues to the function of the brain. Adv Psychobiol. 1974;2:297–312.PubMed Jones HB. The effects of sensual drugs on behavior: clues to the function of the brain. Adv Psychobiol. 1974;2:297–312.PubMed
47.
go back to reference Greaves G. Sexual disturbances among chronic amphetamine users. J Nerv Ment Dis. 1972;155(5):363–5.CrossRefPubMed Greaves G. Sexual disturbances among chronic amphetamine users. J Nerv Ment Dis. 1972;155(5):363–5.CrossRefPubMed
48.
go back to reference Freifeld, CC (2014). Digital pharmacovigilance: The MedWatcher system for monitoring adverse events through automated processing of Internet social media and crowdsourcing (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database (UMI No. 3581025). Freifeld, CC (2014). Digital pharmacovigilance: The MedWatcher system for monitoring adverse events through automated processing of Internet social media and crowdsourcing (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database (UMI No. 3581025).
49.
go back to reference Doing-Harris KM, Zeng-Treitler Q. Computer-assisted update of a consumer health vocabulary through mining of social network data. J Med Internet Res. 2011;13(2):e37.CrossRefPubMedPubMedCentral Doing-Harris KM, Zeng-Treitler Q. Computer-assisted update of a consumer health vocabulary through mining of social network data. J Med Internet Res. 2011;13(2):e37.CrossRefPubMedPubMedCentral
50.
go back to reference Zeng QT, Tse T, Divita G, Keselman A, Crowell J, Browne AC, Goryachev S, Ngo L. Term identification methods for consumer health vocabulary development. J Med Internet Res. 2007;9(1):e4.CrossRefPubMedPubMedCentral Zeng QT, Tse T, Divita G, Keselman A, Crowell J, Browne AC, Goryachev S, Ngo L. Term identification methods for consumer health vocabulary development. J Med Internet Res. 2007;9(1):e4.CrossRefPubMedPubMedCentral
51.
go back to reference Cobert B, Silvey J. The Internet and drug safety: what are the implications for pharmacovigilance? Drug Saf. 1999;20(2):95–107.CrossRefPubMed Cobert B, Silvey J. The Internet and drug safety: what are the implications for pharmacovigilance? Drug Saf. 1999;20(2):95–107.CrossRefPubMed
Metadata
Title
Evaluation of Facebook and Twitter Monitoring to Detect Safety Signals for Medical Products: An Analysis of Recent FDA Safety Alerts
Authors
Carrie E. Pierce
Khaled Bouri
Carol Pamer
Scott Proestel
Harold W. Rodriguez
Hoa Van Le
Clark C. Freifeld
John S. Brownstein
Mark Walderhaug
I. Ralph Edwards
Nabarun Dasgupta
Publication date
01-04-2017
Publisher
Springer International Publishing
Published in
Drug Safety / Issue 4/2017
Print ISSN: 0114-5916
Electronic ISSN: 1179-1942
DOI
https://doi.org/10.1007/s40264-016-0491-0

Other articles of this Issue 4/2017

Drug Safety 4/2017 Go to the issue