Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Health and Quality of Life Outcomes
Published in: Health and Quality of Life Outcomes 1/2014

Open Access 01-12-2014 | Research

Construct and concurrent validity of a patient-reported adverse drug event questionnaire: a cross-sectional study

Authors: Sieta T de Vries, Flora M Haaijer-Ruskamp, Dick de Zeeuw, Petra Denig

Published in: Health and Quality of Life Outcomes | Issue 1/2014

Login to get access

Abstract

Background

Direct patient-reported information about adverse drug events (ADEs) is important since it adds to healthcare professional-reported information about the safety of drugs. Previously, we developed an instrument to assess patient-reported ADEs in research settings. The aim of this study is to assess the construct and concurrent validity of the questionnaire.

Methods

Patients on at least an oral glucose-lowering drug completed the ADE questionnaire, the World Health Organization Quality of Life-BREF, and the Treatment Satisfaction Questionnaire for Medication (TSQM). The ADE questionnaire assesses ADEs for any drug that the patient uses. Construct validity was assessed by testing whether patients reporting an ADE had a lower general quality of life and physical health than those not reporting an ADE, using Mann–Whitney U-tests and t-tests (significance level <0.05). For concurrent validity, we tested whether ADEs that patients associate with particular drugs in the ADE questionnaire are documented in the Summary of Product Characteristics (SPC) of those drugs, and whether patients who report an ADE with the use of metformin on the TSQM, mention metformin as a drug associated with an ADE on the ADE questionnaire. Agreement of 70% with the SPC was considered satisfactory. Sensitivity and positive predictive value (PPV) were calculated for the comparison with the TSQM, where 70% was used as the cut-off level for sufficient concurrent validity.

Results

We included 135 patients (mean age 64 years, 35% women). Patients who reported an ADE (N = 37) had a lower general quality of life and physical health than those not reporting an ADE (P < 0.05). For 78 of the 146 reported ADEs (53%), patients mentioned at least 1 particular drug associated with the ADE. After clustering related ADEs, this resulted in 56 patient-reported ADE-drug associations. Of these, 41 (73%) were in agreement with information in the SPC. Finally, the questionnaire had a sensitivity of 38% and PPV of 79% for assessing ADEs associated with metformin.

Conclusions

The construct validity of the patient-reported ADE questionnaire was sufficient for reporting any versus no ADE, but the concurrent validity was only partly demonstrated. Therefore, the questionnaire needs to be adapted before it can be used.
Appendix
Available only for authorised users
Literature
1.
2.
Berlin JA, Glasser SC, Ellenberg SS: Adverse event detection in drug development: recommendations and obligations beyond phase 3. Am J Public Health 2008, 98: 1366–1371. 10.2105/AJPH.2007.124537PubMedCentralCrossRefPubMed
3.
4.
Basch E, Iasonos A, McDonough T, Barz A, Culkin A, Kris MG, Scher HI, Schrag D: Patient versus clinician symptom reporting using the national cancer institute common terminology criteria for adverse events: results of a questionnaire-based study. Lancet Oncol 2006, 7: 903–909. 10.1016/S1470-2045(06)70910-XCrossRefPubMed
5.
Blenkinsopp A, Wilkie P, Wang M, Routledge PA: Patient reporting of suspected adverse drug reactions: a review of published literature and international experience. Br J Clin Pharmacol 2007, 63: 148–156. 10.1111/j.1365-2125.2006.02746.xPubMedCentralCrossRefPubMed
6.
Hakobyan L, Haaijer-Ruskamp FM, de Zeeuw D, Dobre D, Denig P: Comparing adverse event rates of oral blood glucose-lowering drugs reported by patients and healthcare providers: a post-hoc analysis of observational studies published between 1999 and 2011. Drug Saf 2011, 34: 1191. 10.2165/11593810-000000000-00000CrossRefPubMed
7.
Gawert L, Hierse F, Zink A, Strangfeld A: How well do patient reports reflect adverse drug reactions reported by rheumatologists? Agreement of physician- and patient-reported adverse events in patients with rheumatoid arthritis observed in the German biologics register. Rheumatology (Oxford) 2011, 50: 152–160. 10.1093/rheumatology/keq300CrossRef
8.
9.
10.
Frost MH, Reeve BB, Liepa AM, Stauffer JW, Hays RD: What is sufficient evidence for the reliability and validity of patient-reported outcome measures? Value Health 2007, 10(Suppl 2):94–105. 10.1111/j.1524-4733.2007.00272.xCrossRef
11.
Azevedo AM, Alonso NB, Vidal-Dourado M, Noffs MH, Pascalicchio TF, Caboclo LO, Ciconelli RM, Sakamoto AC, Yacubian EM: Validity and reliability of the Portuguese-Brazilian version of the quality of life in epilepsy inventory-89. Epilepsy Behav 2009, 14: 465–471. 10.1016/j.yebeh.2008.12.010CrossRefPubMed
12.
Carreno M, Donaire A, Falip M, Maestro I, Fernandez S, Nagel AG, Serratosa J, Salas J, Viteri C, Llorens J, Baro E: Validation of the Spanish version of the Liverpool adverse events profile in patients with epilepsy. Epilepsy Behav 2009, 15: 154–159. 10.1016/j.yebeh.2008.11.016CrossRefPubMed
13.
De Smedt RH, Denig P, Haaijer-Ruskamp FM, Jaarsma T: Perceived medication adverse effects and coping strategies reported by chronic heart failure patients. Int J Clin Pract 2009, 63: 233–242. 10.1111/j.1742-1241.2008.01954.xCrossRefPubMed
14.
Foster JM, van Sonderen E, Lee AJ, Sanderman R, Dijkstra A, Postma DS, van der Molen T: A self-rating scale for patient-perceived side effects of inhaled corticosteroids. Respir Res 2006, 24: 131. 10.1186/1465-9921-7-131CrossRef
15.
Jarernsiripornkul N, Krska J, Capps PA, Richards RM, Lee A: Patient reporting of potential adverse drug reactions: a methodological study. Br J Clin Pharmacol 2002, 53: 318–325. 10.1046/j.0306-5251.2001.01547.xPubMedCentralCrossRefPubMed
16.
Corso DM, Pucino F, DeLeo JM, Calis KA, Gallelli JF: Development of a questionnaire for detecting potential adverse drug reactions. Ann Pharmacother 1992, 6: 890–896.
17.
De Vries ST, Mol PG, de Zeeuw D, Haaijer-Ruskamp FM, Denig P: Development and initial validation of a patient-reported adverse drug event questionnaire. Drug Saf 2013, 36: 765–777. 10.1007/s40264-013-0036-8CrossRef
18.
19.
De Vries J, Van Heck GL: WHOQOL-Bref. Universiteit van Tilburg, Tilburg; 1996.
20.
Skevington SM, Lotfy M, O’Connell KA: The world health organization’s WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual Life Res 2004, 13: 299–310. 10.1023/B:QURE.0000018486.91360.00CrossRefPubMed
21.
22.
Naranjo CA, Busto U, Sellers EM, Sandor P, Ruiz I, Roberts EA, Janecek E, Domecq C, Greenblatt DJ: A method for estimating the probability of adverse drug reactions. Clin Pharmacol Ther 1981, 30: 239–245. 10.1038/clpt.1981.154CrossRefPubMed
23.
Krska J, Anderson C, Murphy E, Avery AJ: How patient reporters identify adverse drug reactions: a qualitative study of reporting via the UK yellow card scheme. Drug Saf 2011, 34: 429–436. 10.2165/11589320-000000000-00000CrossRefPubMed
24.
Atkinson MJ, Sinha A, Hass SL, Colman SS, Kumar RN, Brod M, Rowland CR: Validation of a general measure of treatment satisfaction, the treatment satisfaction questionnaire for medication (TSQM), using a national panel study of chronic disease. Health Qual Life Outcomes 2004, 2: 12. 10.1186/1477-7525-2-12PubMedCentralCrossRefPubMed
25.
Standards of medical care in diabetes–2013 Diabetes Care 2013, 36(Suppl 1):11–66. 10.2337/dc13-S011
26.
Rutten GEHM, De Grauw WJC, Nijpels G, Houweling ST, Van de Laar FA, Bilo HJ, Holleman F, Janssen PGH: The NHG guideline diabetes mellitus type 2. Huisarts Wet 2013, 56: 512–525.
27.
Wyrwich KW, Bullinger M, Aaronson N, Hays RD, Patrick DL, Symonds T: Estimating clinically significant differences in quality of life outcomes. Qual Life Res 2005, 14: 285–295. 10.1007/s11136-004-0705-2CrossRefPubMed
28.
Aursnes I, Gjertsen MK: Common adverse events associated with an SSRI: meta-analysis of early paroxetine data. Pharmacoepidemiol Drug Saf 2008, 17: 707–713. 10.1002/pds.1596CrossRefPubMed
29.
Bergk V, Haefeli WE, Gasse C, Brenner H, Martin-Facklam M: Information deficits in the summary of product characteristics preclude an optimal management of drug interactions: a comparison with evidence from the literature. Eur J Clin Pharmacol 2005, 61: 327–335. 10.1007/s00228-005-0943-4CrossRefPubMed
30.
Aagaard L, Hansen EH: Consumers’ reports of suspected adverse drug reactions volunteered to a consumer magazine. Br J Clin Pharmacol 2010, 69: 317–318. 10.1111/j.1365-2125.2009.03584.xPubMedCentralCrossRefPubMed
31.
32.
33.
Deeks JJ, Altman DG: Sensitivity and specificity and their confidence intervals cannot exceed 100%. BMJ 1999, 318: 193–194. 10.1136/bmj.318.7177.193bPubMedCentralCrossRefPubMed
34.
Ernst EJ, Ernst ME, Hoehns JD, Bergus GR: Women’s quality of life is decreased by acute cystitis and antibiotic adverse effects associated with treatment. Health Qual Life Outcomes 2005, 3: 45. 10.1186/1477-7525-3-45PubMedCentralCrossRefPubMed
35.
Guo N, Marra F, Fitzgerald JM, Elwood RK, Marra CA: Impact of adverse drug reaction and predictivity of quality of life status in tuberculosis. Eur Respir J 2010, 36: 206–208. 10.1183/09031936.00159409CrossRefPubMed
36.
Imayama I, Plotnikoff RC, Courneya KS, Johnson JA: Determinants of quality of life in type 2 diabetes population: the inclusion of personality. Qual Life Res 2011, 20: 551–558. 10.1007/s11136-010-9772-8CrossRefPubMed
37.
De Vet H, Terwee C, Mokkink L, Knol D: Measurement in Medicine: A practical guide. University Press, Cambridge; 2011.CrossRef
38.
Chaipichit N, Krska J, Pratipanawatr T, Uchaipichat V, Jarernsiripornkul N: A qualitative study to explore how patients identify and assess symptoms as adverse drug reactions. Eur J Clin Pharmacol 2014, 70: 607–615. 10.1007/s00228-014-1653-6CrossRefPubMed
39.
Basch E, Jia X, Heller G, Barz A, Sit L, Fruscione M, Appawu M, Iasonos A, Atkinson T, Goldfarb S, Culkin A, Kris MG, Schrag D: Adverse symptom event reporting by patients vs clinicians: relationships with clinical outcomes. J Natl Cancer Inst 2009, 101: 1624–1632. 10.1093/jnci/djp386PubMedCentralCrossRefPubMed
40.
Voorham J, Haaijer-Ruskamp FM, Wolffenbuttel BH, Stolk RP, Denig P: Medication adherence affects treatment modifications in patients with type 2 diabetes. Clin Ther 2011, 33: 121–134. 10.1016/j.clinthera.2011.01.024CrossRefPubMed
41.
Harmark L, Alberts S, van Puijenbroek E, Denig P, van Grootheest K: Representativeness of diabetes patients participating in a web-based adverse drug reaction monitoring system. Pharmacoepidemiol Drug Saf 2013, 22: 250–255. 10.1002/pds.3341CrossRefPubMed
42.
Schiotz M, Bogelund M, Willaing I: Challenges using online surveys in a Danish population of people with type 2 diabetes. Chronic Illn 2012, 8: 56–63. 10.1177/1742395311413307CrossRefPubMed
43.
44.
Manfreda KL, Batagelj Z, Vehovar V: Design of Web Survey Questionnaires: Three Basic Experiments. J Computer-Mediated Commun 2002, ᅟ: 7.
45.
Couper MP: Web surveys: a review of issues and approaches. Public Opin Q 2000, 64: 464–494. 10.1086/318641CrossRefPubMed
Metadata
Title
Construct and concurrent validity of a patient-reported adverse drug event questionnaire: a cross-sectional study
Authors
Sieta T de Vries
Flora M Haaijer-Ruskamp
Dick de Zeeuw
Petra Denig
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2014
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-014-0103-6

Other articles of this Issue 1/2014

Health and Quality of Life Outcomes 1/2014 Go to the issue

Research

Construct validity and responsiveness of the simplified version of Ankylosing Spondylitis Disease Activity Score (SASDAS) for the evaluation of disease activity in axial spondyloarthritis

Research

Modelling the relationship between the WOMAC osteoarthritis index and EQ-5D

Research

Building resiliency: a cross-sectional study examining relationships among health-related quality of life, well-being, and disaster preparedness

Review

Patient reports of the outcomes of treatment: a structured review of approaches

Research

Patient-reported outcome labeling claims and measurement approach for metastatic castration-resistant prostate cancer treatments in the United States and European Union

Research

Self-rated dental health and dental insurance: modification by household income