Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2008

Open Access 01-12-2008 | Research article

Examining assumptions regarding valid electronic monitoring of medication therapy: development of a validation framework and its application on a European sample of kidney transplant patients

Authors: Kris Denhaerynck, Petra Schäfer-Keller, James Young, Jürg Steiger, Andreas Bock, Sabina De Geest

Published in: BMC Medical Research Methodology | Issue 1/2008

Login to get access

Abstract

Background

Electronic monitoring (EM) is used increasingly to measure medication non-adherence. Unbiased EM assessment requires fulfillment of assumptions. The purpose of this study was to determine assumptions needed for internal and external validity of EM measurement. To test internal validity, we examined if (1) EM equipment functioned correctly, (2) if all EM bottle openings corresponded to actual drug intake, and (3) if EM did not influence a patient's normal adherence behavior. To assess external validity, we examined if there were indications that using EM affected the sample representativeness.

Methods

We used data from the Supporting Medication Adherence in Renal Transplantation (SMART) study, which included 250 adult renal transplant patients whose adherence to immunosuppressive drugs was measured during 3 months with the Medication Event Monitoring System (MEMS). Internal validity was determined by assessing the prevalence of nonfunctioning EM systems, the prevalence of patient-reported discrepancies between cap openings and actual intakes (using contemporaneous notes and interview at the end of the study), and by exploring whether adherence was initially uncharacteristically high and decreased over time (an indication of a possible EM intervention effect). Sample representativeness was examined by screening for differences between participants and non-participants or drop outs on non-adherence.

Results

Our analysis revealed that some assumptions were not fulfilled: 1) one cap malfunctioned (0.4%), 2) self-reported mismatches between bottle openings and actual drug intake occurred in 62% of the patients (n = 155), and 3) adherence decreased over the first 5 weeks of the monitoring, indicating that EM had a waning intervention effect.

Conclusion

The validity assumptions presented in this article should be checked in future studies using EM as a measure of medication non-adherence.
Appendix
Available only for authorised users
Literature
1.
go back to reference Liu H, Golin CE, Miller LG, Hays RD, Beck CK, Sanandaji S, Christian J, Maldonado T, Duran D, Kaplan AH, et al: A comparison study of multiple measures of adherence to HIV protease inhibitors. Ann Intern Med. 2001, 134: 968-977.CrossRefPubMed Liu H, Golin CE, Miller LG, Hays RD, Beck CK, Sanandaji S, Christian J, Maldonado T, Duran D, Kaplan AH, et al: A comparison study of multiple measures of adherence to HIV protease inhibitors. Ann Intern Med. 2001, 134: 968-977.CrossRefPubMed
2.
go back to reference Cramer JA: Microelectronic systems for monitoring and enhancing patient compliance with medication regimens. Drugs. 1995, 49: 321-327. 10.2165/00003495-199549030-00001.CrossRefPubMed Cramer JA: Microelectronic systems for monitoring and enhancing patient compliance with medication regimens. Drugs. 1995, 49: 321-327. 10.2165/00003495-199549030-00001.CrossRefPubMed
3.
go back to reference Chaisson RE, Barnes GL, Hackman J, Watkinson L, Kimbrough L, Metha S, Cavalcante S, Moore RD: A randomized, controlled trial of interventions to improve adherence to isoniazid therapy to prevent tuberculosis in injection drug users. Am J Med. 2001, 110: 610-615. 10.1016/S0002-9343(01)00695-7.CrossRefPubMed Chaisson RE, Barnes GL, Hackman J, Watkinson L, Kimbrough L, Metha S, Cavalcante S, Moore RD: A randomized, controlled trial of interventions to improve adherence to isoniazid therapy to prevent tuberculosis in injection drug users. Am J Med. 2001, 110: 610-615. 10.1016/S0002-9343(01)00695-7.CrossRefPubMed
4.
go back to reference Wendel CS, Mohler MJ, Kroesen K, Ampel NM, Gifford AL, Coons SJ: Barriers to use of electronic adherence monitoring in an HIV clinic. Ann Pharmacother. 2001, 35: 1010-1015. 10.1345/aph.10349.CrossRefPubMed Wendel CS, Mohler MJ, Kroesen K, Ampel NM, Gifford AL, Coons SJ: Barriers to use of electronic adherence monitoring in an HIV clinic. Ann Pharmacother. 2001, 35: 1010-1015. 10.1345/aph.10349.CrossRefPubMed
6.
go back to reference Bova CA, Fennie KP, Knafl GJ, Dieckhaus KD, Watrous E, Williams AB: Use of electronic monitoring devices to measure antiretroviral adherence: practical considerations. AIDS Behav. 2005, 9: 103-110. 10.1007/s10461-005-1685-0.CrossRefPubMed Bova CA, Fennie KP, Knafl GJ, Dieckhaus KD, Watrous E, Williams AB: Use of electronic monitoring devices to measure antiretroviral adherence: practical considerations. AIDS Behav. 2005, 9: 103-110. 10.1007/s10461-005-1685-0.CrossRefPubMed
7.
go back to reference Weng FL, Israni AK, Joffe MM, Hoy T, Gaughan CA, Newman M, Abrams JD, Kamoun M, Rosas SE, Mange KC, et al: Race and electronically measured adherence to immunosuppressive medications after deceased donor renal transplantation. J Am Soc Nephrol. 2005, 16: 1839-1848. 10.1681/ASN.2004121059.CrossRefPubMed Weng FL, Israni AK, Joffe MM, Hoy T, Gaughan CA, Newman M, Abrams JD, Kamoun M, Rosas SE, Mange KC, et al: Race and electronically measured adherence to immunosuppressive medications after deceased donor renal transplantation. J Am Soc Nephrol. 2005, 16: 1839-1848. 10.1681/ASN.2004121059.CrossRefPubMed
8.
go back to reference Fennie KP, Bova CA, Williams AB: Adjusting and censoring electronic monitoring device data. Implications for study outcomes. J Acquir Immune Defic Syndr. 2006, 43 (Suppl 1): S88-95.CrossRefPubMed Fennie KP, Bova CA, Williams AB: Adjusting and censoring electronic monitoring device data. Implications for study outcomes. J Acquir Immune Defic Syndr. 2006, 43 (Suppl 1): S88-95.CrossRefPubMed
9.
go back to reference Deschamps AE, Graeve VD, van Wijngaerden E, De Saar V, Vandamme AM, Van Vaerenbergh K, Ceunen H, Bobbaers H, Peetermans WE, De Vleeschouwer PJ, et al: Prevalence and correlates of nonadherence to antiretroviral therapy in a population of HIV patients using Medication Event Monitoring System. AIDS Patient Care STDS. 2004, 18: 644-657. 10.1089/apc.2004.18.644.CrossRefPubMed Deschamps AE, Graeve VD, van Wijngaerden E, De Saar V, Vandamme AM, Van Vaerenbergh K, Ceunen H, Bobbaers H, Peetermans WE, De Vleeschouwer PJ, et al: Prevalence and correlates of nonadherence to antiretroviral therapy in a population of HIV patients using Medication Event Monitoring System. AIDS Patient Care STDS. 2004, 18: 644-657. 10.1089/apc.2004.18.644.CrossRefPubMed
10.
go back to reference Dunbar-Jacob J, Sereika S, Rohay JM, Burke LE: Electronic methods in assessing adherence to medical regimens. Technology and methods in behavioral medicine. Edited by: Krantz D, Baum A Mahwah. 1998, NJ: Lawrence Erlbaum Associates, 95-113. Dunbar-Jacob J, Sereika S, Rohay JM, Burke LE: Electronic methods in assessing adherence to medical regimens. Technology and methods in behavioral medicine. Edited by: Krantz D, Baum A Mahwah. 1998, NJ: Lawrence Erlbaum Associates, 95-113.
11.
go back to reference Burke LE: Electronic measurement. Compliance in Healthcare and Research. Edited by: Burke LE, Ockene IS. 2001, Armonk: Futura Publishing Co, 117-138. Burke LE: Electronic measurement. Compliance in Healthcare and Research. Edited by: Burke LE, Ockene IS. 2001, Armonk: Futura Publishing Co, 117-138.
12.
go back to reference De Geest S, Abraham I, Moons P, Vandeputte M, Van Cleemput J, Evers G, Daenen W, Vanhaecke J: Late acute rejection and subclinical noncompliance with cyclosporine therapy in heart transplant recipients. J Heart Lung Transplant. 1998, 17: 854-863.PubMed De Geest S, Abraham I, Moons P, Vandeputte M, Van Cleemput J, Evers G, Daenen W, Vanhaecke J: Late acute rejection and subclinical noncompliance with cyclosporine therapy in heart transplant recipients. J Heart Lung Transplant. 1998, 17: 854-863.PubMed
13.
go back to reference Matsui D, Hermann C, Klein J, Berkovitch M, Olivieri N, Koren G: Critical comparison of novel and existing methods of compliance assessment during a clinical trial of an oral iron chelator. J Clin Pharmacol. 1994, 34: 944-949.CrossRefPubMed Matsui D, Hermann C, Klein J, Berkovitch M, Olivieri N, Koren G: Critical comparison of novel and existing methods of compliance assessment during a clinical trial of an oral iron chelator. J Clin Pharmacol. 1994, 34: 944-949.CrossRefPubMed
14.
go back to reference Elixhauser A, Eisen SA, Romeis JC, Homan SM: The effects of monitoring and feedback on compliance. Med Care. 1990, 28: 882-893. 10.1097/00005650-199010000-00003.CrossRefPubMed Elixhauser A, Eisen SA, Romeis JC, Homan SM: The effects of monitoring and feedback on compliance. Med Care. 1990, 28: 882-893. 10.1097/00005650-199010000-00003.CrossRefPubMed
15.
go back to reference Wagner GJ: Does discontinuing the use of pill boxes to facilitate electronic monitoring impede adherence?. Int J STD AIDS. 2003, 14: 64-65. 10.1258/095646203321043327.CrossRefPubMed Wagner GJ: Does discontinuing the use of pill boxes to facilitate electronic monitoring impede adherence?. Int J STD AIDS. 2003, 14: 64-65. 10.1258/095646203321043327.CrossRefPubMed
16.
go back to reference Wagner GJ, Ghosh-Dastidar B: Electronic monitoring: adherence assessment or intervention?. HIV Clin Trials. 2002, 3: 45-51. 10.1310/XGXU-FUDK-A9QT-MPTF.CrossRefPubMed Wagner GJ, Ghosh-Dastidar B: Electronic monitoring: adherence assessment or intervention?. HIV Clin Trials. 2002, 3: 45-51. 10.1310/XGXU-FUDK-A9QT-MPTF.CrossRefPubMed
17.
go back to reference Reddel HK, Toelle BG, Marks GB, Ware SI, Jenkins CR, Woolcock AJ: Analysis of adherence to peak flow monitoring when recording of data is electronic. BMJ. 2002, 324: 146-147. 10.1136/bmj.324.7330.146.CrossRefPubMedPubMedCentral Reddel HK, Toelle BG, Marks GB, Ware SI, Jenkins CR, Woolcock AJ: Analysis of adherence to peak flow monitoring when recording of data is electronic. BMJ. 2002, 324: 146-147. 10.1136/bmj.324.7330.146.CrossRefPubMedPubMedCentral
18.
go back to reference Fulmer TT, Feldman PH, Kim TS, Carty B, Beers M, Molina M, Putnam M: An intervention study to enhance medication compliance in community-dwelling elderly individuals. J Gerontol Nurs. 1999, 25: 6-14.CrossRefPubMed Fulmer TT, Feldman PH, Kim TS, Carty B, Beers M, Molina M, Putnam M: An intervention study to enhance medication compliance in community-dwelling elderly individuals. J Gerontol Nurs. 1999, 25: 6-14.CrossRefPubMed
19.
go back to reference Bertholet N, Favrat B, Fallab-Stubi CL, Brunner HR, Burnier M: Why objective monitoring of compliance is important in the management of hypertension. J Clin Hypertens (Greenwich). 2000, 2: 258-262. Bertholet N, Favrat B, Fallab-Stubi CL, Brunner HR, Burnier M: Why objective monitoring of compliance is important in the management of hypertension. J Clin Hypertens (Greenwich). 2000, 2: 258-262.
20.
go back to reference Yeung M, O'Connor SA, Parry DT, Cochrane GM: Compliance with prescribed drug therapy in asthma. Respir Med. 1994, 88: 31-35. 10.1016/0954-6111(94)90171-6.CrossRefPubMed Yeung M, O'Connor SA, Parry DT, Cochrane GM: Compliance with prescribed drug therapy in asthma. Respir Med. 1994, 88: 31-35. 10.1016/0954-6111(94)90171-6.CrossRefPubMed
21.
go back to reference Cramer JA, Ouellette VL, Mattson RH: Effect of microelectronic observation on compliance. Epilepsia. 1990, 21: 617-618. Cramer JA, Ouellette VL, Mattson RH: Effect of microelectronic observation on compliance. Epilepsia. 1990, 21: 617-618.
22.
go back to reference Denhaerynck K, Steiger J, Bock A, Schafer-Keller P, Kofer S, Thannberger N, De Geest S: Prevalence and risk factors of non-adherence with immunosuppressive medication in kidney transplant patients. Am J Transplant. 2007, 7: 108-116. 10.1111/j.1600-6143.2006.01611.x.CrossRefPubMed Denhaerynck K, Steiger J, Bock A, Schafer-Keller P, Kofer S, Thannberger N, De Geest S: Prevalence and risk factors of non-adherence with immunosuppressive medication in kidney transplant patients. Am J Transplant. 2007, 7: 108-116. 10.1111/j.1600-6143.2006.01611.x.CrossRefPubMed
23.
go back to reference Hastie T, Tibshirani RJ: Generalized Additive Models. 1990, London: Chapman & Hall Hastie T, Tibshirani RJ: Generalized Additive Models. 1990, London: Chapman & Hall
25.
go back to reference Vrijens B, Tousset E, Rode R, Bertz R, Mayer S, Urquhart J: Successful projection of the time course of drug concentration in plasma during a 1-year period from electronically compiled dosing-time data used as input to individually parameterized pharmacokinetic models. J Clin Pharmacol. 2005, 45: 461-467. 10.1177/0091270004274433.CrossRefPubMed Vrijens B, Tousset E, Rode R, Bertz R, Mayer S, Urquhart J: Successful projection of the time course of drug concentration in plasma during a 1-year period from electronically compiled dosing-time data used as input to individually parameterized pharmacokinetic models. J Clin Pharmacol. 2005, 45: 461-467. 10.1177/0091270004274433.CrossRefPubMed
26.
go back to reference Deschamps AE, Denhaerynck K, Vandamme A, Van Wijngaerden E, De Geest S: Electronic Monitoring induces a 40-day intervention effect in HIV-patients. JAIDS. 2006, 2- Deschamps AE, Denhaerynck K, Vandamme A, Van Wijngaerden E, De Geest S: Electronic Monitoring induces a 40-day intervention effect in HIV-patients. JAIDS. 2006, 2-
27.
go back to reference Dunbar-Jacob J, Foley S: A historical overview of medication adherence. Methodological issues in the study of adherence. Edited by: Dunbar-Jacob J, Erlen J, Schlenk E, Stilley C. 2005, Pittsburg: School of Nursing Dunbar-Jacob J, Foley S: A historical overview of medication adherence. Methodological issues in the study of adherence. Edited by: Dunbar-Jacob J, Erlen J, Schlenk E, Stilley C. 2005, Pittsburg: School of Nursing
28.
go back to reference Vrijens B, Goetghebeur E: Comparing compliance patterns between randomized treatments. Control Clin Trials. 1997, 18: 187-203. 10.1016/S0197-2456(96)00235-8.CrossRefPubMed Vrijens B, Goetghebeur E: Comparing compliance patterns between randomized treatments. Control Clin Trials. 1997, 18: 187-203. 10.1016/S0197-2456(96)00235-8.CrossRefPubMed
29.
go back to reference Osterberg L, Blaschke T: Adherence to medication. N Engl J Med. 2005, 353: 487-497. 10.1056/NEJMra050100.CrossRefPubMed Osterberg L, Blaschke T: Adherence to medication. N Engl J Med. 2005, 353: 487-497. 10.1056/NEJMra050100.CrossRefPubMed
30.
go back to reference Glass TR, De Geest S, Weber R, Vernazza PL, Rickenbach M, Furrer H, Bernasconi E, Cavassini M, Hirschel B, Battegay M, et al: Correlates of self-reported nonadherence to antiretroviral therapy in HIV-infected patients: the Swiss HIV Cohort Study. J Acquir Immune Defic Syndr. 2006, 41: 385-392. 10.1097/01.qai.0000186371.95301.52.CrossRefPubMed Glass TR, De Geest S, Weber R, Vernazza PL, Rickenbach M, Furrer H, Bernasconi E, Cavassini M, Hirschel B, Battegay M, et al: Correlates of self-reported nonadherence to antiretroviral therapy in HIV-infected patients: the Swiss HIV Cohort Study. J Acquir Immune Defic Syndr. 2006, 41: 385-392. 10.1097/01.qai.0000186371.95301.52.CrossRefPubMed
Metadata
Title
Examining assumptions regarding valid electronic monitoring of medication therapy: development of a validation framework and its application on a European sample of kidney transplant patients
Authors
Kris Denhaerynck
Petra Schäfer-Keller
James Young
Jürg Steiger
Andreas Bock
Sabina De Geest
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2008
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-8-5

Other articles of this Issue 1/2008

BMC Medical Research Methodology 1/2008 Go to the issue