Skip to main content
Top
Published in: Systematic Reviews 1/2014

Open Access 01-12-2014 | Research

Failure or success of search strategies to identify adverse effects of medical devices: a feasibility study using a systematic review

Authors: Su Golder, Kath Wright, Mark Rodgers

Published in: Systematic Reviews | Issue 1/2014

Login to get access

Abstract

Background

Research has indicated that adverse effects terms are increasingly prevalent in the title, abstract or indexing terms of articles that contain adverse drug effects data in MEDLINE and Embase. However, it is unknown whether adverse effects terms are present in the database records of articles that contain adverse effects data of medical devices, and thus, to what extent the development of an adverse effects search filter for medical devices may be feasible.

Methods

A case study systematic review of a medical device was selected. The included studies from a systematic review of the safety of recombinant human bone morphogenetic protein-2 (rhBMP-2) for spinal fusion were used in the analysis. For each included study, the corresponding database record on MEDLINE and Embase was assessed to measure the presence or absence of adverse effects terms in the title, abstract or indexing. The performance of each potential adverse effects search term was also measured and compared.

Results

There were 82 publications (49 studies) included in the systematic review with 51 of these indexed on MEDLINE and 55 on Embase. Ninety-four percent (48/51) of the records on MEDLINE and 95% (52/55) of the records on Embase contained at least one adverse effects related search term. The wide variety of adverse effects terms included in the title, abstract or indexing of bibliographic records, and the lack of any individual high-performing search terms suggests that a combination of terms in different fields is required to identify adverse effects of medical devices. In addition, the most successful search terms differed from the most successful terms for identifying adverse drug effects.

Conclusions

The search filters currently available for adverse drug effects are not necessarily useful for searching adverse effects data of medical devices. The presence of adverse effects terms in the bibliographic records of articles on medical devices, however, indicates that combinations of adverse effects search terms may be useful in search strategies in MEDLINE and Embase. The results, therefore, suggest that not only a search filter for the adverse effects of medical devices is feasible, but also that it should be a research priority.
Appendix
Available only for authorised users
Literature
1.
go back to reference Chou RAN, Atkinsc D, Ismailad AS, Santaguidad P, Smith DH, Whitlock E, Wilt TJ, Moher D: AHRQ Series Paper 4: assessing harms when comparing medical interventions: AHRQ and the effective health-care program. J Clin Epidemiol. 2010, 63: 502-512. 10.1016/j.jclinepi.2008.06.007.CrossRefPubMed Chou RAN, Atkinsc D, Ismailad AS, Santaguidad P, Smith DH, Whitlock E, Wilt TJ, Moher D: AHRQ Series Paper 4: assessing harms when comparing medical interventions: AHRQ and the effective health-care program. J Clin Epidemiol. 2010, 63: 502-512. 10.1016/j.jclinepi.2008.06.007.CrossRefPubMed
2.
go back to reference Golder SLY: Search strategies to identify information on adverse effects: a systematic review. J Med Libr Assoc. 2009, 97 (2): 84-92. 10.3163/1536-5050.97.2.004.CrossRefPubMedPubMedCentral Golder SLY: Search strategies to identify information on adverse effects: a systematic review. J Med Libr Assoc. 2009, 97 (2): 84-92. 10.3163/1536-5050.97.2.004.CrossRefPubMedPubMedCentral
3.
go back to reference Golder S, Loke YK: The performance of adverse effects search filters in MEDLINE and EMBASE. Health Inf Libr J. 2012, 29 (2): 141-151. 10.1111/j.1471-1842.2012.00980.x.CrossRef Golder S, Loke YK: The performance of adverse effects search filters in MEDLINE and EMBASE. Health Inf Libr J. 2012, 29 (2): 141-151. 10.1111/j.1471-1842.2012.00980.x.CrossRef
4.
go back to reference Golder S, Loke YK: Failure or success of electronic search strategies to identify adverse effects data. J Med Libr Assoc. 2012, 100 (2): 130-134. 10.3163/1536-5050.100.2.012.CrossRefPubMedPubMedCentral Golder S, Loke YK: Failure or success of electronic search strategies to identify adverse effects data. J Med Libr Assoc. 2012, 100 (2): 130-134. 10.3163/1536-5050.100.2.012.CrossRefPubMedPubMedCentral
5.
go back to reference Farrah KMU, Cimon MK: Playing it safe: validating search filters for adverse events. Poster presented at: 2013 Annual Meeting and Exhibition of the Medical Library Association Add to My Files (MLA ‘13), the 11th International Congress on Medical Librarianship (ICML), the 7th International Conference of Animal Health Information Specialists (ICAHIS), and the 6th International Clinical Librarian Conference (ICLC). 2013 May 3–8, One Health: Information in an Interdependent World, Boston, MA. Available from: http://www.cadth.ca/media/is/MLA-Poster_Kelly.pdf Farrah KMU, Cimon MK: Playing it safe: validating search filters for adverse events. Poster presented at: 2013 Annual Meeting and Exhibition of the Medical Library Association Add to My Files (MLA ‘13), the 11th International Congress on Medical Librarianship (ICML), the 7th International Conference of Animal Health Information Specialists (ICAHIS), and the 6th International Clinical Librarian Conference (ICLC). 2013 May 3–8, One Health: Information in an Interdependent World, Boston, MA. Available from: http://​www.​cadth.​ca/​media/​is/​MLA-Poster_​Kelly.​pdf
6.
go back to reference Rodgers MABJ, Heirs MK, Higgins JP, Mannion RJ, Simmonds MC, Stewart LA: Reporting of industry funded study outcome data: comparison of confidential and published data on the safety and effectiveness of rhBMP-2 for spinal fusion. BMJ. 2013, 346: f3981-10.1136/bmj.f3981.CrossRefPubMedPubMedCentral Rodgers MABJ, Heirs MK, Higgins JP, Mannion RJ, Simmonds MC, Stewart LA: Reporting of industry funded study outcome data: comparison of confidential and published data on the safety and effectiveness of rhBMP-2 for spinal fusion. BMJ. 2013, 346: f3981-10.1136/bmj.f3981.CrossRefPubMedPubMedCentral
7.
go back to reference Simmonds MBJ, Heirs M, Higgins JPT, Mannion R, Rodgers M, Stewart L: Safety and effectiveness of recombinant human bone morphogenetic protein-2 for spinal fusion: a meta-analysis of individual-participant data. Ann Intern Med. 2013, 158 (12): 877-889. 10.7326/0003-4819-158-12-201306180-00005.CrossRefPubMed Simmonds MBJ, Heirs M, Higgins JPT, Mannion R, Rodgers M, Stewart L: Safety and effectiveness of recombinant human bone morphogenetic protein-2 for spinal fusion: a meta-analysis of individual-participant data. Ann Intern Med. 2013, 158 (12): 877-889. 10.7326/0003-4819-158-12-201306180-00005.CrossRefPubMed
8.
go back to reference Derry SLY, Aronson K: Incomplete evidence: the inadequacy of databases in tracing published adverse drug reactions in clinical trials. BMC Med Res Methodol. 2001, 1: 7-10.1186/1471-2288-1-7.CrossRefPubMedPubMedCentral Derry SLY, Aronson K: Incomplete evidence: the inadequacy of databases in tracing published adverse drug reactions in clinical trials. BMC Med Res Methodol. 2001, 1: 7-10.1186/1471-2288-1-7.CrossRefPubMedPubMedCentral
10.
go back to reference Ioannidis JP, Evans SJ, Gotzsche PC, O’Neill RT, Altman DG, Schulz K, Moher D: Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004, 141 (10): 781-788. 10.7326/0003-4819-141-10-200411160-00009.CrossRefPubMed Ioannidis JP, Evans SJ, Gotzsche PC, O’Neill RT, Altman DG, Schulz K, Moher D: Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004, 141 (10): 781-788. 10.7326/0003-4819-141-10-200411160-00009.CrossRefPubMed
11.
go back to reference Haidich AB, Birtsou C, Dardavessis T, Tirodimos I, Arvanitidou M: The quality of safety reporting in trials is still suboptimal: survey of major general medical journals. J Clin Epidemiol. 2011, 64 (2): 124-135. 10.1016/j.jclinepi.2010.03.005.CrossRefPubMed Haidich AB, Birtsou C, Dardavessis T, Tirodimos I, Arvanitidou M: The quality of safety reporting in trials is still suboptimal: survey of major general medical journals. J Clin Epidemiol. 2011, 64 (2): 124-135. 10.1016/j.jclinepi.2010.03.005.CrossRefPubMed
12.
go back to reference Yazici Y: Safety reporting in randomized clinical trials—a need for improvement. Bull NYU Hosp Jt Dis. 2009, 67 (2): 209-210.PubMed Yazici Y: Safety reporting in randomized clinical trials—a need for improvement. Bull NYU Hosp Jt Dis. 2009, 67 (2): 209-210.PubMed
13.
go back to reference Papanikolaou PN, Churchill R, Wahlbeck K, Ioannidis JP: Safety reporting in randomized trials of mental health interventions. Am J Psychiatry. 2004, 161 (9): 1692-1697. 10.1176/appi.ajp.161.9.1692.CrossRefPubMed Papanikolaou PN, Churchill R, Wahlbeck K, Ioannidis JP: Safety reporting in randomized trials of mental health interventions. Am J Psychiatry. 2004, 161 (9): 1692-1697. 10.1176/appi.ajp.161.9.1692.CrossRefPubMed
14.
go back to reference Ioannidis JP, Lau J: Improving safety reporting from randomised trials. Drug Saf. 2002, 25 (2): 77-84. 10.2165/00002018-200225020-00002.CrossRefPubMed Ioannidis JP, Lau J: Improving safety reporting from randomised trials. Drug Saf. 2002, 25 (2): 77-84. 10.2165/00002018-200225020-00002.CrossRefPubMed
15.
go back to reference Neidig JL, Koletar SL: Safety reporting in clinical trials. JAMA. 2001, 285 (16): 2077-2078.PubMed Neidig JL, Koletar SL: Safety reporting in clinical trials. JAMA. 2001, 285 (16): 2077-2078.PubMed
16.
go back to reference Kohl KS, Bonhoeffer J: Steering Committee of the Brighton C. Safety reporting in clinical trials. JAMA. 2001, 285 (16): 2076-2077. 10.1001/jama.285.16.2076.CrossRefPubMed Kohl KS, Bonhoeffer J: Steering Committee of the Brighton C. Safety reporting in clinical trials. JAMA. 2001, 285 (16): 2076-2077. 10.1001/jama.285.16.2076.CrossRefPubMed
17.
go back to reference Ioannidis JP, Lau J: Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA. 2001, 285 (4): 437-443. 10.1001/jama.285.4.437.CrossRefPubMed Ioannidis JP, Lau J: Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA. 2001, 285 (4): 437-443. 10.1001/jama.285.4.437.CrossRefPubMed
18.
go back to reference Chowers MY, Gottesman BS, Leibovici L, Pielmeier U, Andreassen S, Paul M: Reporting of adverse events in randomized controlled trials of highly active antiretroviral therapy: systematic review. J Antimicrob Chemother. 2009, 64 (2): 239-250. 10.1093/jac/dkp191.CrossRefPubMed Chowers MY, Gottesman BS, Leibovici L, Pielmeier U, Andreassen S, Paul M: Reporting of adverse events in randomized controlled trials of highly active antiretroviral therapy: systematic review. J Antimicrob Chemother. 2009, 64 (2): 239-250. 10.1093/jac/dkp191.CrossRefPubMed
19.
go back to reference Yazici Y: Some concerns about adverse event reporting in randomized clinical trials. Bull NYU Hosp Jt Dis. 2008, 66 (2): 143-145.PubMed Yazici Y: Some concerns about adverse event reporting in randomized clinical trials. Bull NYU Hosp Jt Dis. 2008, 66 (2): 143-145.PubMed
20.
go back to reference Cheng CW, Bian ZX, Li YP, Moher D, Wu TX, Dagenais S, Li J, Li TQ: Transparently reporting adverse effects of traditional Chinese medicine interventions in randomized controlled trials. Zhong Xi Yi Jie He Xue Bao. 2008, 6 (9): 881-886. 10.3736/jcim20080901.CrossRefPubMed Cheng CW, Bian ZX, Li YP, Moher D, Wu TX, Dagenais S, Li J, Li TQ: Transparently reporting adverse effects of traditional Chinese medicine interventions in randomized controlled trials. Zhong Xi Yi Jie He Xue Bao. 2008, 6 (9): 881-886. 10.3736/jcim20080901.CrossRefPubMed
21.
go back to reference Bauer KA, Hammerman S, Rapoport B, Lacouture ME: Completeness in the reporting of dermatologic adverse drug reactions associated with monoclonal antibody epidermal growth factor receptor inhibitors in phase II and III colorectal cancer clinical trials. Clin Colorectal Cancer. 2008, 7 (5): 309-314. 10.3816/CCC.2008.n.040. Research Support, Non-U.S. Gov’t ReviewCrossRefPubMed Bauer KA, Hammerman S, Rapoport B, Lacouture ME: Completeness in the reporting of dermatologic adverse drug reactions associated with monoclonal antibody epidermal growth factor receptor inhibitors in phase II and III colorectal cancer clinical trials. Clin Colorectal Cancer. 2008, 7 (5): 309-314. 10.3816/CCC.2008.n.040. Research Support, Non-U.S. Gov’t ReviewCrossRefPubMed
22.
go back to reference Woodworth T, Furst DE, Alten R, Bingham C, Yocum D, Sloan V, Tsuji W, Stevens R, Fries J, Witter J, Johnson K, Lassere M, Brooks P: Standardizing assessment and reporting of adverse effects in rheumatology clinical trials II: the Rheumatology Common Toxicity Criteria v.2.0. J Rheumatol. 2007, 34 (6): 1401-1414. Consensus Development ConferencePubMed Woodworth T, Furst DE, Alten R, Bingham C, Yocum D, Sloan V, Tsuji W, Stevens R, Fries J, Witter J, Johnson K, Lassere M, Brooks P: Standardizing assessment and reporting of adverse effects in rheumatology clinical trials II: the Rheumatology Common Toxicity Criteria v.2.0. J Rheumatol. 2007, 34 (6): 1401-1414. Consensus Development ConferencePubMed
23.
go back to reference Nuovo J, Sather C: Reporting adverse events in randomized controlled trials. Pharmacoepidemiol Drug Saf. 2007, 16 (3): 349-351. 10.1002/pds.1310.CrossRefPubMed Nuovo J, Sather C: Reporting adverse events in randomized controlled trials. Pharmacoepidemiol Drug Saf. 2007, 16 (3): 349-351. 10.1002/pds.1310.CrossRefPubMed
24.
go back to reference Extermann M: More thoughts on the reporting of adverse events in cancer clinical trials. J Clin Oncol. 2007, 25 (7): 918-CrossRefPubMed Extermann M: More thoughts on the reporting of adverse events in cancer clinical trials. J Clin Oncol. 2007, 25 (7): 918-CrossRefPubMed
25.
go back to reference Burfeind DB: Streamlining adverse event reporting in trials. Dermatol Nurs. 2006, 18 (4): 381-382.PubMed Burfeind DB: Streamlining adverse event reporting in trials. Dermatol Nurs. 2006, 18 (4): 381-382.PubMed
26.
go back to reference Anderson SJ: Some thoughts on the reporting of adverse events in phase II cancer clinical trials. J Clin Oncol. 2006, 24 (24): 3821-3822. 10.1200/JCO.2006.06.9856.CrossRefPubMed Anderson SJ: Some thoughts on the reporting of adverse events in phase II cancer clinical trials. J Clin Oncol. 2006, 24 (24): 3821-3822. 10.1200/JCO.2006.06.9856.CrossRefPubMed
27.
go back to reference Lassere MN, Johnson KR, Woodworth TG, Furst DE, Fries JF, Kirwan JR, Tugwell PS, Day RO, Brooks PM: Challenges and progress in adverse event ascertainment and reporting in clinical trials. J Rheumatol. 2005, 32 (10): 2030-2032.PubMed Lassere MN, Johnson KR, Woodworth TG, Furst DE, Fries JF, Kirwan JR, Tugwell PS, Day RO, Brooks PM: Challenges and progress in adverse event ascertainment and reporting in clinical trials. J Rheumatol. 2005, 32 (10): 2030-2032.PubMed
28.
go back to reference Trotti A, Bentzen SM: The need for adverse effects reporting standards in oncology clinical trials. J Clin Oncol. 2004, 22 (1): 19-22.CrossRefPubMed Trotti A, Bentzen SM: The need for adverse effects reporting standards in oncology clinical trials. J Clin Oncol. 2004, 22 (1): 19-22.CrossRefPubMed
29.
go back to reference Liauw WS, Day RO: Adverse event reporting in clinical trials: room for improvement. Med J Aust. 2003, 179 (8): 426-428.PubMed Liauw WS, Day RO: Adverse event reporting in clinical trials: room for improvement. Med J Aust. 2003, 179 (8): 426-428.PubMed
30.
go back to reference Martin PJ, Antin JH, Weisdorf DJ, Paton V, Horowitz MM: Reporting of adverse event data in hematopoietic stem cell transplantation clinical trials involving investigational new drugs or devices: a report from the William Guy Forbeck Foundation 2001 focus meeting on clinical trials in hematopoietic stem cell transplantation. Biol Blood Marrow Transplant. 2002, 8 (6): 295-302. 10.1016/S1083-8791(02)50027-6.CrossRefPubMed Martin PJ, Antin JH, Weisdorf DJ, Paton V, Horowitz MM: Reporting of adverse event data in hematopoietic stem cell transplantation clinical trials involving investigational new drugs or devices: a report from the William Guy Forbeck Foundation 2001 focus meeting on clinical trials in hematopoietic stem cell transplantation. Biol Blood Marrow Transplant. 2002, 8 (6): 295-302. 10.1016/S1083-8791(02)50027-6.CrossRefPubMed
31.
go back to reference Loke YK, Derry S: Reporting of adverse drug reactions in randomised controlled trials—a systematic survey. BMC Clin Pharml. 2001, 1: 3-CrossRef Loke YK, Derry S: Reporting of adverse drug reactions in randomised controlled trials—a systematic survey. BMC Clin Pharml. 2001, 1: 3-CrossRef
32.
go back to reference Ethgen M, Boutron I, Steg PG, Roy C, Ravaud P: Reporting of harm in randomized controlled trials evaluating stents for percutaneous coronary intervention. Trials. 2009, 10: 29-10.1186/1745-6215-10-29.CrossRefPubMedPubMedCentral Ethgen M, Boutron I, Steg PG, Roy C, Ravaud P: Reporting of harm in randomized controlled trials evaluating stents for percutaneous coronary intervention. Trials. 2009, 10: 29-10.1186/1745-6215-10-29.CrossRefPubMedPubMedCentral
33.
go back to reference Ethgen M, Boutron I, Baron G, Giraudeau B, Sibilia J, Ravaud P: Reporting of harm in randomized, controlled trials of nonpharmacologic treatment for rheumatic disease. Ann Intern Med. 2005, 143 (1): 20-25. 10.7326/0003-4819-143-1-200507050-00006.CrossRefPubMed Ethgen M, Boutron I, Baron G, Giraudeau B, Sibilia J, Ravaud P: Reporting of harm in randomized, controlled trials of nonpharmacologic treatment for rheumatic disease. Ann Intern Med. 2005, 143 (1): 20-25. 10.7326/0003-4819-143-1-200507050-00006.CrossRefPubMed
Metadata
Title
Failure or success of search strategies to identify adverse effects of medical devices: a feasibility study using a systematic review
Authors
Su Golder
Kath Wright
Mark Rodgers
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2014
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-3-113

Other articles of this Issue 1/2014

Systematic Reviews 1/2014 Go to the issue