Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A novel statistical method for assessing effective adherence to medication and calculating optimal drug dosages

  • Garrett Greene ,

    Roles Conceptualization, Data curation, Investigation, Methodology, Software, Writing – original draft

    garrettgreene@rcsi.ie

    Affiliations Division of Population Health Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland, Clinical Research Centre, Beaumont Hospital, Dublin, Ireland

  • Richard W. Costello,

    Roles Conceptualization, Writing – original draft

    Affiliations Clinical Research Centre, Beaumont Hospital, Dublin, Ireland, Department of Medicine, Royal College of Surgeons in Ireland, Dublin, Ireland

  • Breda Cushen,

    Roles Data curation, Writing – original draft

    Affiliations Clinical Research Centre, Beaumont Hospital, Dublin, Ireland, Department of Medicine, Royal College of Surgeons in Ireland, Dublin, Ireland

  • Imran Sulaiman,

    Roles Data curation, Investigation

    Affiliations Clinical Research Centre, Beaumont Hospital, Dublin, Ireland, Department of Medicine, Royal College of Surgeons in Ireland, Dublin, Ireland

  • Elaine Mac Hale,

    Roles Data curation, Project administration

    Affiliations Clinical Research Centre, Beaumont Hospital, Dublin, Ireland, Department of Medicine, Royal College of Surgeons in Ireland, Dublin, Ireland

  • Ronan M. Conroy,

    Roles Conceptualization, Supervision

    Affiliation Division of Population Health Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland

  • Frank Doyle

    Roles Conceptualization, Investigation, Supervision, Writing – original draft

    Affiliation Division of Population Health Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland

Abstract

Objective

We derive a novel model-based metric for effective adherence to medication, and validate it using data from the INhaler Compliance Assessment device (INCATM). This technique employs dose timing data to estimate the threshold drug concentration needed to maintain optimal health.

Methods

The parameters of the model are optimised against patient outcome data using maximum likelihood methods. The model is fitted and validated by secondary analysis of two independent datasets from two remote-monitoring studies of adherence, conducted through clinical research centres of 5 Irish hospitals. Training data came from a cohort of asthma patients (~ 47,000 samples from 218 patients). Validation data is from a cohort of 204 patients with COPD recorded between 2014 and 2016.

Results

The time above threshold measure is strongly predictive of adverse events (exacerbations) in COPD patients (Odds Ratio of exacerbation = 0.52 per SD increase in adherence, 95% Confidence Interval [0.34–0.79]). This compares well with the best known previous method, the Area Under the dose-time Curve (AUC) (Odds Ratio = 0.69, 95% Confidence Interval [0.48–0.99]). In addition, the fitted value of the dose threshold (0.56 of prescribed dosage) suggests that prescribed doses may be unnecessarily high given good adherence.

Conclusions

The resulting metric accounts for missed doses, dose-timing errors, and errors in inhaler technique, and provides enhanced predictive validity in comparison to previously used measures. In addition, the method allows us to estimate the correct dosage required to achieve the effect of the medication using the patients’ own adherence data and outcomes. The adherence score does depend not on sex or other demographic factors suggesting that effective adherence is driven by individual behavioural factors.

Introduction

The necessity of adherence assessment

Non-Adherence to prescribed treatment regimens is not only a persistent challenge in chronic disease management [13], but can also be a confounding factor when interpreting clinical trial results [4]. Good adherence (i.e. correctly following agreed recommendations from a healthcare provider [5, 6]), can include taking medications as directed, increasing physical activity, modifying diet, etc., and is often difficult to ensure or assess.

However the benefits of good adherence are clear: On average, those who adhere to therapy have significantly better health outcomes while non-adherence confers considerable costs on healthcare providers and patients [1, 3, 5, 710]. Consider the example of Chronic Obstructive Pulmonary Disease (COPD).While inhaled bronchodilator drugs are efficacious in reducing the rate of exacerbations of COPD and improving exercise capacity and quality of life [11, 12], estimates of adherence in COPD vary widely depending on the definitions and measures used. Reported rates are 70–90% in clinical drug trials to 20–60% in observational studies [8, 13, 14]. Despite the overall evidence for long-acting inhaled therapy from clinical trials, there remains a significant gap between efficacy and effectiveness [15]. A recent systematic review has demonstrated that, although studies were heterogeneous, non-adherence in COPD was associated with mortality, increased hospitalisations, impaired quality of life and reduced productivity [8]. Thus, promoting adherence to appropriate medication is an important clinical goal.

Measuring adherence in a clinical setting

Assessing adherence to medication is an essential element both in the ongoing management of chronic disease and in the development of novel treatments. Indeed, in a clinical setting, any attempt to determine the effectiveness of a medication on an individual patient can be hopelessly confounded by a lack of accurate adherence information, potentially leading to over-prescription or unnecessary additional treatment [16, 17]. This is particularly true in the case of inhaled medications, where errors in inhaler technique can result in the patient receiving a drastically reduced dose, unbeknownst to clinicians [18, 19].

In recent years, adherence has been codified using the ABC Taxonomy [20], which defines three stages of adherence; initiation, implementation and discontinuation. In this paper we consider patients receiving ongoing treatment for chronic illness, and as a result we will primarily address the implementation element, namely, the regularity and proficiency with which patients take their inhaler.

There are several established ways to assess implementation adherence to inhaled medications [1, 3, 5, 6, 2123]. However, each of these methods has significant drawbacks. Perhaps the most widely used is patient self-report which has been shown to be susceptible to reporting biases, with little or no correlation between self-report and objective adherence measures [2326]. Alternatively, medication checks such as pharmacy reconciliation, refill rates and drug counter checks can be performed to assess adherence [3, 4, 14, 23]. Although these methods have their own strengths, they do not provide information about individual behaviours, such as when and how medicine is actually taken, and cannot detect certain behaviours such as medication dumping or sharing, which negatively affect actual adherence. In addition, these measures cannot account for variations in dose-timing. Consequently, they represent, at best, an informative upper-bound for true adherence rates.

The INCA device and AUC metric.

The effectiveness of many inhaled medications depends critically on correct dose timing as well as on inhaler technique, which must be accounted for in order to assess the patient’s response to treatment [18, 2729].

The INCATM device is an acoustic remote-monitoring device for use with dry powder inhalers (Fluticasone/Salmeterol “Seretide” DiskusTM), which can record the precise timing of inhaler use, as well as identifying errors in inhaler technique. Using data from this device, Sulaiman et al. recently developed a novel area under the curve (AUC) metric, which combines data on time-of-use with assessment of inhaler technique to account for critical errors. Using remote monitoring data obtained from the INCATM device, they applied this metric to a cohort of 244 COPD patients [29], and found that, while the mean number of doses taken was 59.8% of expected, once technique errors were accounted for the mean actual adherence rate was only 22.6%.

The need to account for dose timing.

While the AUC metric mentioned above represents an improvement over standard methods, this and other metrics remain suboptimal. Both standard adherence assessments and recent remote monitoring studies rely on summary scores, such as monthly dose count, monthly AUC [29], or prescription refill rate,with the result that the effects of dose timing are ignored. Furthermore these methods implicitly assume that the effectiveness of treatment is a linear function of the dose received, which is known to be untrue, particularly in the case of steroids [30, 31].

In general, if the aim of medication is to maintain a target concentration of the prescribed drug in the system [30, 3234], then we argue that adherence should be defined in terms of the maintained drug concentration, rather than the total number of doses received. Thus, a measure of effective adherence which takes into account the pharmacodynamics of the drug in question may be more effective in predicting outcomes [35]. To demonstrate, in this proof-of-concept paper, we will derive a novel and objectively-derived metric which relies explicitly on dose timing, and can also account for the effects of poor ingestion (in this case, poor inhaler technique). In doing so we aim is to the relationship between precisely-timed patterns of adherence and the associated short-term changes in lung-function and risk of exacerbation, for example, the effect of a delayed dose on subsequent lung function or exacerbation risk over a period of several days. In the following we will:

  • Define and mathematically derive a model-based measure of effective adherence
  • Fit this model against training data from a cohort of asthma patients
  • Validate the model by testing in a COPD sample

Methods

As mentioned above, if the aim of medication is to maintain a target concentration of the prescribed drug in the system, then the measure of treatment received should be defined in terms of the maintained drug concentration, rather than just the total number of doses received [36]. Fig 1 below shows an illustrative example of how dose timing may affect drug concentration. In both cases the patient has taken the same number of doses over the period shown. However in example (b), the patient displays erratic dose timing, with the result that the concentration drops below target concentration (blue dashed line) for approximately 40% of the period shown.

thumbnail
Fig 1. Simulated absorbed ICS concentrations for two patients using Seretide inhalers, with target threshold concentration, θ.

In both cases the patient has received 4 doses over the period shown. The patient in (a) is more successful in maintaining above-target concentration, while in (b) the concentration drops below target on several occasions.

https://doi.org/10.1371/journal.pone.0195663.g001

Therefore, we propose that the adherence rate could be better defined as the proportion of time for which the patient maintains an above-threshold drug concentration. This is achieved by modelling the time course of drug concentration for the particular medication in question and applying a sigmoidal threshold function to the concentration values.

By including an estimate of the absorbed drug concentration, the model described here bears a certain similarity to those employed in the field of Pharmaco-Kinetics (PK) to describe the absorption and elimination rates of pharmaceuticals. Indeed, previous studies have exploited the interface between PK models and adherence to improve estimates of medication effectiveness [36, 37]. However, while PK models are concerned with the precise description of biochemical pathways and drug metabolism, our model is rather concerned with estimating the therapeutic effectiveness of treatment. Thus the parameters of our metric are specifically fitted against relevant measures of clinical outcomes, and quantify aspects of the patient’s responsiveness to treatment, rather than specific biological properties.

Deriving a model-based measure of adherence

We define a measure of adherence based on dose timing and technique information obtained from a remote monitoring device such as the INCA. However, it should be noted that this method is not specific to this particular device or treatment, and may potentially be applied to a range of treatments whose use can be accurately timed. A schematic of this model is shown in Fig 2.

thumbnail
Fig 2. Schematic of time-above-threshold calculation.

This method allows us to calculate a single robust adherence score based on timing and technique data from the monitoring device. First, the set of dose times is convolved with an exponential kernel to estimate the concentration over time (top). This concentration is then passed through a sigmoidal threshold function (bottom) and the output integrated to give the proportion of time above threshold.

https://doi.org/10.1371/journal.pone.0195663.g002

Given a set of dose timings, {ts}, and technique scores {δs}, we model the time course of the inhaled drug concentration, C(t). In the case of inhaled medications such as those employed here, the drug is absorbed rapidly by the targeted tissues [33, 34], and so the time-course of the concentration can be approximated by an exponential function of the form (1) Where ts is the set of dose times obtained from the monitoring device, and the parameter α represents the decay rate of the drug in question, and is related to the physiological half-life by the standard equation (2)

In the case of other medications, where the absorption of the drug cannot be approximated as instantaneous, suitable PK profiles may be used to obtain a more appropriate estimate of C(t).

The parameter δs is a technique score, representing the proportion of the full dose received. This takes the value of 1 for correctly taken doses, and values between 0 and 1 for doses where technique errors were made. In our datasets this score is obtained from the INCATM device, which assesses the efficiency of inhalation on each inhaler use [38, 39].

Since δ = 1 for all correctly taken doses, independent of the actual dosage, the concentration, C(t) and threshold value, θ, are expressed in units of the prescribed dosage (see S1 Mathematical Appendix).

To determine the proportion of time spent above threshold, the concentration value is then passed through a sigmoidal threshold function: (3)

The form of this function matches that of the standard dose-response curve, and thus models the non-linear dependence of patient outcomes on drug concentration [30, 31, 40].

The parameters θ and β, of the threshold function represent the threshold value and the threshold sharpness respectively. That is, θ represents the target drug concentration needed to control the condition, while the parameter β captures how strongly the adherence score depends on the threshold. Thus, for large values of β, the threshold function approximates a step function, with a value of 1 when the concentration is above threshold, and 0 otherwise. For small values of β the transition becomes smoother, and the threshold effect is weaker (see Fig 3).

thumbnail
Fig 3. The effects of parameters θ and β on the threshold function.

For large values of β the function becomes step-like, while for small values it is smoother, and approximately linear. Changes in θ shift the function to the right or left.

https://doi.org/10.1371/journal.pone.0195663.g003

Finally, a summary adherence score for the clinically relevant time period can now be obtained by averaging the output of the threshold function over the time interval in question, giving a value A between 0 and 1 representing the proportion of time above threshold: (4)

Threshold concentration and required dosage

We have defined adherence in terms of the threshold concentration, θ, and an increment δ, where both θ and δ are expressed in units of the prescribed dosage. Using equations (1)-(4) we can thus derive the relationship between the threshold level and the dosage required to maintain that concentration under perfect adherence (See S1 Mathematical Appendix): (5) where δr is the required dose, expressed in units of the current dosage, and h is a constant corresponding to the expected number of half-lives between doses. In the case where the interval between doses equals the half-life, we get δr = θ, and so the threshold level can be interpreted as the proportion of the current dosage needed to maintain health. (e.g. θ = 0.5 would imply that half the current dosage would suffice under perfect adherence). Furthermore, given an estimate of the average adherence rate for a particular patient, this required dosage can be easily adjusted to determine a patient-specific dosage.

Model fitting

The adherence measure described above depends explicitly on the values of the parameters α (drug decay rate), δ (technique score), β (threshold steepness parameter), θ (optimal drug threshold). While the technique parameter δ is a property of the specific delivery method used, the decay constant α and threshold parameters β and θ reflect the physiology of the cohort in question and of the condition being treated, and so are not known a priori. As a result, to obtain the most useful clinical measure of adherence, we can optimise our model by fitting these parameters so that the resulting adherence score gives the best prediction of patient outcomes. The optimisation is performed using standard maximum likelihood methods (see S1 Mathematical Appendix for details).

In this paper we apply our model to a population of patients with COPD. This population is of particular clinical interest for adherence studies, being characterised by poor adherence and frequent re-admission to hospital. However, due to the very high level of technique errors in this cohort (errors detected in approximately 60% of all inhaler uses), it proved difficult to robustly fit our model using this dataset. In order to avoid this problem, and obtain a sufficiently robust model which is not prone to over-fitting, we instead optimise the model using ‘training data’ from a distinct cohort of acute asthma sufferers, before validating the model against our COPD data. This has the advantage of providing a larger set of usable training data, as well as eliminating any problem due to overfitting, since the training and validation datasets are completely distinct.

It should be noted that the treatment in question in this study (ICS-LABA inhalers) contain two distinct drug components, namely a steroid component and a long acting beta-agonist, which target distinct aspects of lung disease. In our case, while LABA may have a short term effect on PEFR, we might expect the steroid component of the drug to be more predictive of longer-term measures like exacerbation rate. As a result, by choosing an outcome against which to optimise the model, we implicitly optimise the model to capture the effect of one or the other of these components.

Datasets

Training data: Uncontrolled asthma cohort.

The model was optimised using pre-existing adherence data and measures of clinical outcomes obtained from a clinical trial of the INCATM device in an asthma cohort [41, 42] (Table 1.). This was a randomised controlled trial for an adherence intervention using the INCA device fitted to SeretideTM salmeterol/fluticasone inhalers. The training set consisted of up to three months of adherence and clinical data from 218 otherwise healthy patients with moderate to severe uncontrolled asthma. All patients were prescribed a twice-daily dose, intended to be taken at intervals of 12 hours.

The data contain two principal clinical outcomes:

  • Twice daily measurements of Peak Expiratory Flow Rate (PEFR)
  • Monthly recording of occurrence of Asthma Exacerbations

PEFR was measured recorded twice daily using a hand-held electronic peak flow meter. In total the dataset contained 16,934 PEFR measurements, while there were 85 self-reported exacerbations and 64 physician-defined exacerbations during the study period. Self-reported exacerbations were defined as a significant worsening of symptoms which resulted in the prescription of oral steroids. Physician-defined exacerbations were defined from analysis of PEFR recordings, and relate to a sustained clinically-significant drop in PEFR (20%). For the purposes of model fitting self-reported exacerbations were used, however analysis of exacerbation timing showed good agreement between self-report and physician defined exacerbations for this cohort.

Given these two outcome measures, we can separately optimise the model against each outcome, to obtain individual estimates of the parameters (α,δ,β,θ).

When fitting against the occurrence of adverse events, which is a binary measure covering a one-month period, the predictor used is the overall monthly adherence score (α,δ,β,θ). When fitting against daily peak flow data, we employ a moving average of daily adherence scores, with lag time τ, determined from the reverse correlation of peak flow against adherence.

Parameter values obtained from each of these optimisation methods are broadly similar, and so for validation purposes we consider only those estimates obtained using the monthly exacerbation data.

Validation data: The INCA-COPD cohort.

We investigated the predictive validity of our fitted model by applying it to adherence data from a separate observational cohort of patients with COPD (INCA-COPD [43]). This study gathered 3 months of adherence data from 265 patients, of whom 204 had usable adherence data. These patients generally exhibit very poor adherence, which may be in part due to high levels of cognitive impairment and co-morbidity (Table 2). In total there were 226 self-reported exacerbations among this cohort during the three months of the study.

As in the asthma study, all patients were prescribed a twice daily dose from a fluticasone/salmeterol inhaler, to be taken at regular 12 hour intervals, and had their adherence to this regimen monitored using the INCA device for a period of three months. No daily PEFR measurements were available for this cohort, and so self-reported exacerbations were used as the outcome of interest. Specifically, we use the adherence score calculated over a single month as a predictor of the number of exacerbations reported within that month, for each of the three months in the study.

Results

Fitted parameter values and dosages

Tables 3 and 4 below show the values of the technique parameter, δ, and model parameters (α,β,θ,τ) respectively. The values of δ shown were obtained from calibration tests of the INCA device [44].

thumbnail
Table 3. Values of parameter δ corresponding to particular technique errors.

Results obtained from calibration tests of the INCA device [44].

https://doi.org/10.1371/journal.pone.0195663.t003

thumbnail
Table 4. Fitted parameter values obtained using Peak Expiratory Flow Rate (PEFR) and Adverse event rate (AE rate) respectively as target outcomes.

https://doi.org/10.1371/journal.pone.0195663.t004

Table 4 shows values of fitted parameters obtained using maximum likelihood model fitting against both target variables. In both cases the predictive power of the model showed a weak dependency on β within a broad range of values, (approximately 50–100) indicating that the exact slope of the threshold function is not of great importance. However in both cases, the model accuracy depended strongly on the threshold value, with optimal values of approximately 0.56 (95% C.I. 0.49–0.7) and 0.69 (0.52–0.75) for peak flow and A.E rate respectively.

Optimal values of the decay rate, α, corresponded in both cases to half lives in the region of 12 hours. This matches the expected interval between doses (twice daily), and so from Eq (5) we can interpret the corresponding threshold value, as the proportion of the current dosage needed under perfect adherence (for more detail on the relationship between prescribed dosage and threshold value, see S1 Mathematical Appendix).

This suggests that the currently prescribed dose is larger than needed for this particular cohort (optimal dose = 0.56 or 0.69 times the current dose), assuming good adherence.

It is interesting to note that analysis of predictors of adherence found no dependence on sex, age or other demographic factors (data not shown). This suggests that effective adherence is driven by individual behavioural or clinical factors.

Predictive validity of new adherence model

Participants were classified according to whether or not they reported an exacerbation within a one-month period, and adherence scores from the same period were used as a predictor in a logistic regression model. As shown in Table 5, adherence scores calculated using our threshold method were found to be highly predictive of self-reported exacerbations, with a 48% reduction in odds of an exacerbation per standard deviation increase in adherence score (Odds Ratio = 0.52, p = 0.002). In particular, our adherence measure gave greatly improved prediction of exacerbations compared to the best previously known method, the AUC metric (Odds ratio 0.69, p = 0.04).

thumbnail
Table 5. Logistic regression of self-reported exacerbation against our new adherence metric (left) and the AUC metric (right) [29].

https://doi.org/10.1371/journal.pone.0195663.t005

Discussion

Recent advances in remote monitoring technology provide rich sources of data on adherence to medication [38, 4547]. At the same time, the increased focus on data-driven medicine and the development of numerous advanced biomarkers has raised the possibility of individualised or patient-specific treatment of many chronic conditions [4850]. However, to fully take advantage of these possibilities we require the corresponding analytical tools, which will allow us to properly exploit the complexity of these data, and provide the necessary links between treatment, adherence and outcomes.

The method described in this paper is hoped to be a significant step in this direction. Rather than considering dosing, treatment, and adherence assessment as independent processes, we hope to demonstrate that they are in fact part of a single complex relationship between patient’s behaviour and their health, and are as a result inextricably linked.

This method represents both a technical advance over previously used methods of adherence assessment, and an opportunity for the development of individualised treatments for chronic conditions such as COPD.

Advantages over established methods

By incorporating specific information about the delivery method, effectiveness and pharmaco-kinetics of any given drug, the metric described here offers several significant advantages over previously used methods. First, it explicitly captures the exponential decay of drug concentration, while by contrast other methods of adherence employ linear summation of doses taken, or similar. Thus, this metric is sensitive to dose-timing effects which are ignored by previous methods. Second, steroid medications, such as those used in inhalers, are known to exhibit sigmoidal dose-response curves [31, 51], with the result that they are most effective only when a minimum concentration has been reached, but have little additional benefit at higher concentrations [30, 31]. These effects are specifically accounted for by the use of a sigmoidal threshold function. As a result, the time-above-threshold metric is significantly predictive of patient outcomes (see Table 5).

Model parameters and dosage calculation

Unlike standard measures of adherence, this method is based on a parametric modelling of the patient’s response to a specific medication. Two of these parameters, α and δ, depend primarily on the specific drug and delivery method, and may be taken from the literature or established through direct measurement. However the values of the threshold parameters, β and θ, are not established and cannot be easily determined experimentally. Instead, these parameters are fitted against patient outcome data (e.g. peak-flow, number of exacerbations) and the chosen values of these parameters are defined as those for which the adherence measure is most strongly predictive of patient outcomes. In simple terms, we define our model as: “The best predictor of the outcome variable (either variations in peak flow or occurrence of exacerbations) is the amount of time the patient spends above threshold value θ.” We then find the value of θ which best fits this model.

As a result, what we obtain here is a purely functional measure of adherence, which is specific to a particular drug, disease, and patient cohort. In fact, rather than assess how well the patient complies with a one-size-fits-all treatment plan, it is more accurate to say that with this method we attempt to assess to what extent the patient is receiving the required level of treatment to maintain good health, given the specific condition being treated.

We are able, therefore, to derive a formula (Eq 5) which defines the optimal dosage needed to treat a condition using patient adherence and outcome data.

Closing the loop between treatment and adherence

Recent years have seen an increase in studies of adherence, but also in a focus on behaviour-driven and data-driven approaches to medicine. Increasingly, the distinctions between these approaches are blurred. By expressing adherence in terms of parameters which are themselves determined a posteriori from the patients’ clinical data, we make an explicit connection between the measurement of adherence and the measurement of treatment effectiveness.

While the results presented here employ a single parameter set to describe an entire patient cohort, the relationship between the threshold parameter and the required dosage, defined by Eq 5 suggests clear possibilities for the development of more individualised treatment. Given the increasing availability of adherence monitoring data, it may soon be possible to apply this method to determine patient-specific thresholds, and hence, patient specific dosing plans.

Increasingly the use of highly sensitive biomarkers allows patients to be classified according to their individual responsiveness to treatment [48]. For example, in the case of steroid medications such as those employed here, a number of biomarkers such as Fraction of Exhaled Nitrous Oxide (FeNO), eosinophil count and urinary bromotyrosine level (BrTyr), have been identified as highly sensitive predictors of patient response [52, 53]. Given sufficiently sensitive biomarkers such as these, and precisely timed adherence data, the method described here can feasibly be employed to determine a patient specific threshold level, and thus determine on a patient-by-patient basis the dosage needed to treat conditions such as asthma and COPD. It is our intention to demonstrate this in the near future using data from a cohort of asthma patients whose adherence and response to treatment are monitored using the INCA device and repeated FeNO measurements respectively.

Generalisation to other conditions and clinical trials

While the data used in this study are obtained from the INCA device, the method described here is a general one, which can potentially be applied to a wide range of other treatments. It may be employed with little or no alteration to other inhaled treatment regimens such as SMART [54], while more generally it can potentially be adapted for use with almost any treatment or delivery method that can be precisely monitored. For example, remote monitoring of injections in treatment of HIV and diabetes has been common for several years, while numerous methods for the remote timing of pill ingestion have been developed [45, 47, 5557]. However, while a wealth of adherence information is available for these treatments, little or no effort has been made to apply modelling techniques such as those described here. It is our intention to develop the method described above into a more general framework combined with a software implementation, which could be applied to datasets from any of these other devices or adherence monitors.

However, perhaps the most interesting possibility for the wider application of this method is in clinical trials. It is widely acknowledged that non-adherence presents a significant problem in ambulatory drug trials, with a wide range of adherence assessments in use [5861]. A high degree of variability in adherence among trial participants can have the effect of introducing increase variability in patient response, as well as a reduction in overall response to treatment, with a resulting decrease in statistical power [61]. As a result, larger patient numbers are required to achieve sufficient power, with corresponding increases in cost. Our adherence allows variability in adherence to be explicitly accounted for when determining the effectiveness of treatment, which has the potential to improve the sensitivity and cost-effectiveness of such trials. In addition, we describe a method to explicitly determine appropriate dosages based on the adherence data of the trial population.

Limitations and future work

While we believe that we have demonstrated the utility of our adherence model, it must be acknowledged that the work presented here has several limitations. The most important limitation is in the paucity of outcome data for our COPD population. While we have discussed the possibility of calculating cohort-specific or patient-specific dosages, we were in fact unable to do this in the case of our population of interest, due to a lack of sufficient data on patient outcomes against which to fit the model. Similarly, while exacerbations are an important clinical outcome, patients’ reported symptoms may provide a more accurate measure of quality of life and well-being, and as such would be an equally valid outcome measure. However, due to a lack of consistent reporting of symptoms between our two datasets, it was not possible to model this outcome here.

Instead, we fitted our model using a more detailed dataset from acohort of asthma sufferers, and applied this model to predict outcomes for our COPD cohort. While less than ideal, this does has the benefit of completely avoiding the risk of over-fitting our model. Indeed, the fact that a model fitted against data from one cohort could be used to predict outcomes for an entirely different cohort tends to demonstrate the robustness of the model. Nonetheless, it would be preferable to fit the model directly against data from the target population using a sufficiently sensitive biomarker as the outcome variable–future work should address this.

This study is also limited in that we have modelled only the effect of preventative medication (ICS-LABA), and have not accounted for the use of additional reliever medications (e.g. salbutamol inhalers). It is acknowledged that many patients may compensate for poor adherence to ICS by reliance on reliever medication [62], and so a complete understanding of the relationship between adherence and outcomes would also require the monitoring of such medications. While the method described here may be easily applied to salbutamol, or other inhaled reliever medications, such data was not available to us, and so could not be included in this study. Future work should address this.

Furthermore, while we hope this paper will be of interest to those involved in the treatment of chronic disease, we appreciate that a practical implementation of this method would be of much greater utility. We are currently engaged in the production of a software package in Stata to implement this method, and have provided here Stata code for the calculation of adherence scores with an accompanying sample dataset. It is our hope that these packages will be of use in the development and testing of new treatments, as well as in clinical practice, through the provision of accurate estimates of dosages required, as well as the provision of improved feedback on adherence to patients with chronic illness.

Supporting information

S1 Mathematical Appendix. Additional information on model fitting, calculation of likelihood functions, and optimal dosage calculation.

https://doi.org/10.1371/journal.pone.0195663.s001

(DOCX)

S1 Dataset. Minimal dataset required to reproduce primary result (Table 5).

https://doi.org/10.1371/journal.pone.0195663.s002

(DTA)

S2 Dataset. Example raw INCA data for use with stata code (S1 Stata Code).

https://doi.org/10.1371/journal.pone.0195663.s003

(DTA)

S1 Stata Code. Demonstration stata code for calculation of threshold adherence metric.

https://doi.org/10.1371/journal.pone.0195663.s004

(DO)

References

  1. 1. Horne R, Weinman J, Barber N, Elliott R, Morgan M, Cribb A, et al. Concordance, adherence and compliance in medicine taking. A conceptual map and research priorities. London: National Co-ordinating Centre for NHS Service Delivery and Organisation NCCSDO, 2005 December. Report No.
  2. 2. Ruppar TM, Dobbels F, Lewek P, Matyjaszczyk M, Siebens K, De Geest SM. Systematic Review of Clinical Practice Guidelines for the Improvement of Medication Adherence. Int J Behav Med. 2015. pmid:25805550.
  3. 3. Dima AL, Hernandez G, Cunillera O, Ferrer M, de Bruin M, group A- L. Asthma inhaler adherence determinants in adults: systematic review of observational data. Eur Respir J. 2015;45(4):994–1018. pmid:25504997.
  4. 4. Blaschke TF, Osterberg L, Vrijens B, Urquhart J. Adherence to medications: insights arising from studies on the unreliable link between prescribed and actual drug dosing histories. Annu Rev Pharmacol Toxicol. 2012;52:275–301. pmid:21942628.
  5. 5. WHO. Adherence to long-term therapies. Geneva: World Health Organisation, 2003.
  6. 6. Glynn L, Fahey T. Cardiovascular medication: improving adherence. Clinical Evidence. 2009;8(220).
  7. 7. DiMatteo MR, Giordani PJ, Lepper HS, Croghan TW. Patient adherence and medical treatment outcomes: a meta-analysis. Med Care. 2002;40(9):794–811. Epub 2002/09/10. pmid:12218770.
  8. 8. van Boven JF, Chavannes NH, van der Molen T, Rutten-van Molken MP, Postma MJ, Vegter S. Clinical and economic impact of non-adherence in COPD: A systematic review. Respiratory medicine. 2014;108(1):103–13. pmid:24070566.
  9. 9. Chowdhury R, Khan H, Heydon E, Shroufi A, Fahimi S, Moore C, et al. Adherence to cardiovascular therapy: a meta-analysis of prevalence and clinical consequences. Eur Heart J. 2013;34(38):2940–8. Epub 2013/08/03. pmid:23907142.
  10. 10. Bender BG. Nonadherence in chronic obstructive pulmonary disease patients: what do we know and what should we do next? Current opinion in pulmonary medicine. 2014;20(2):132–7. Epub 2014/01/24. pmid:24452102.
  11. 11. Tashkin DP, Celli B, Senn S, Burkhart D, Kesten S, Menjoge S, et al. A 4-year trial of tiotropium in chronic obstructive pulmonary disease. The New England journal of medicine. 2008;359(15):1543–54. pmid:18836213.
  12. 12. Nannini LJ, Cates CJ, Lasserson TJ, Poole P. Combined corticosteroid and long-acting beta-agonist in one inhaler versus long-acting beta-agonists for chronic obstructive pulmonary disease. The Cochrane database of systematic reviews. 2007;(4):CD006829. pmid:17943918.
  13. 13. Almagro P, Castro A. Helping COPD patients change health behavior in order to improve their quality of life. International journal of chronic obstructive pulmonary disease. 2013;8:335–45. pmid:23901267; PubMed Central PMCID: PMC3726303.
  14. 14. Di Martino M, Agabiti N, Bauleo L, Kirchmayer U, Cascini S, Pistelli R, et al. Use Patterns of Long-acting Bronchodilators in Routine COPD Care: The OUTPUL Study. Copd. 2013. pmid:24090036.
  15. 15. Revicki DA, Frank L. Pharmacoeconomic evaluation in the real world. Effectiveness versus efficacy studies. PharmacoEconomics. 1999;15(5):423–34. pmid:10537960.
  16. 16. Pasina L, Brucato A, Falcone C, Cucchi E, Bresciani A, Sottocorno M, et al. Medication non-adherence among elderly patients newly discharged and receiving polypharmacy. Drugs & aging. 2014;31(4):283–9.
  17. 17. Steurer-Stey C, Dallalana K, Jungi M, Rosemann T. Management of chronic obstructive pulmonary disease in Swiss primary care: room for improvement. Quality in primary care. 2012;20(5):365. pmid:23114004
  18. 18. Chan AHY, Harrison J, Black PN, Mitchell EA, Foster JM. Using electronic monitoring devices to measure inhaler adherence: a practical guide for clinicians. The Journal of Allergy and Clinical Immunology: In Practice. 2015;3(3):335–49. e5. pmid:25840665
  19. 19. Sulaiman I, Seheult J, MacHale E, D'Arcy S, Boland F, McCrory K, et al. Irregular and ineffective: a quantitative observational study of the time and technique of inhaler use. The Journal of Allergy and Clinical Immunology: In Practice. 2016;4(5):900–9. e2. pmid:27587321
  20. 20. Vrijens B, De Geest S, Hughes DA, Przemyslaw K, Demonceau J, Ruppar T, et al. A new taxonomy for describing and defining adherence to medications. British journal of clinical pharmacology. 2012;73(5):691–705. pmid:22486599
  21. 21. Karve S, Cleves MA, Helm M, Hudson TJ, West DS, Martin BC. Good and poor adherence: optimal cut-point for adherence measures using administrative claims data. Current medical research and opinion. 2009;25(9):2303–10. pmid:19635045
  22. 22. Sattler ELP, Lee JS, Perri M. Medication (re) fill adherence measures derived from pharmacy claims data in older Americans: a review of the literature. Drugs & aging. 2013;30(6):383–99.
  23. 23. Lareau SC, Yawn BP. Improving adherence with inhaler therapy in COPD. International journal of chronic obstructive pulmonary disease. 2010;5:401–6. pmid:21191434; PubMed Central PMCID: PMC3008325.
  24. 24. Nguyen TM, La Caze A, Cottrell N. What are validated self-report adherence scales really measuring?: a systematic review. Br J Clin Pharmacol. 2014;77(3):427–45. pmid:23803249; PubMed Central PMCID: PMC3952718.
  25. 25. Moran K, Doyle F, Sulaiman I, Molloy G, Reilly R, Costello R, et al. The INCA (Inhaler Compliance Aid)–validation against established measures of adherence. European Health Psychologist. 2016;18(S):383.
  26. 26. Lam WY, Fresco P. Medication adherence measures: an overview. BioMed research international. 2015;2015.
  27. 27. Bryant J, McDonald VM, Boyes A, Sanson-Fisher R, Paul C, Melville J. Improving medication adherence in chronic obstructive pulmonary disease: a systematic review. Respiratory research. 2013;14(1):109.
  28. 28. Gill CJ, Sabin LL, Hamer DH, Keyi X, Jianbo Z, Li T, et al. Importance of dose timing to achieving undetectable viral loads. AIDS and Behavior. 2010;14(4):785–93. pmid:19353263
  29. 29. Sulaiman I, Seheult J, MacHale E, Boland F, O’Dwyer SM, Rapcan V, et al. A Method to Calculate Adherence to Inhaled Therapy that Reflects the Changes in Clinical Features of Asthma. Annals of the American Thoracic Society. 2016;13(11):1894–903. pmid:27467125
  30. 30. Holt S, Herxheimer A, Suder A, Weatherall M, Cheng S, Shirtcliffe P, et al. Dose-response relation of inhaled fluticasone propionate in adolescents and adults with asthma: meta-analysisCommentary: Dosage needs systematic and critical review. Bmj. 2001;323(7307):253. pmid:11485952
  31. 31. Adams N, Jones P. The dose–response characteristics of inhaled corticosteroids when used to treat asthma: an overview of Cochrane systematic reviews. Respiratory medicine. 2006;100(8):1297–306. pmid:16806876
  32. 32. Kang J-S, Lee M-H. Overview of therapeutic drug monitoring. The Korean journal of internal medicine. 2009;24(1):1–10. pmid:19270474
  33. 33. Cazzola M, Testi R, Matera MG. Clinical pharmacokinetics of salmeterol. Clinical pharmacokinetics. 2002;41(1):19–30. pmid:11825095
  34. 34. Harrison T, Tattersfield A. Plasma concentrations of fluticasone propionate and budesonide following inhalation from dry powder inhalers by healthy and asthmatic subjects. Thorax. 2003;58(3):258–60. pmid:12612308
  35. 35. Levy G. A pharmacokinetic perspective on medicament noncompliance. Clinical Pharmacology & Therapeutics. 1993;54(3):242–4.
  36. 36. Morrison A, Stauffer ME, Kaufman AS. Defining medication adherence in individual patients. Patient preference and adherence. 2015;9:893. pmid:26170639
  37. 37. Savic RM, Barrail‐Tran A, Duval X, Nembot G, Panhard X, Descamps D, et al. Effect of adherence as measured by MEMS, ritonavir boosting, and CYP3A5 genotype on atazanavir pharmacokinetics in treatment‐naive HIV‐infected patients. Clinical Pharmacology & Therapeutics. 2012;92(5):575–83.
  38. 38. D'Arcy S, MacHale E, Seheult J, Holmes MS, Hughes C, Sulaiman I, et al. A method to assess adherence in inhaler use through analysis of acoustic recordings of inhaler events. PLoS One. 2014;9(6):e98701. pmid:24905012
  39. 39. Taylor TE, Holmes MS, Sulaiman I, Costello RW, Reilly RB. Monitoring inhaler inhalations using an acoustic sensor proximal to inhaler devices. Journal of aerosol medicine and pulmonary drug delivery. 2016;29(5):439–46. pmid:26859629
  40. 40. Powell H, Gibson PG. Inhaled corticosteroid doses in asthma: an evidence-based approach. Medical journal of Australia. 2003;178(5):223–5. pmid:12603186
  41. 41. Sulaiman I, Mac Hale E, Holmes M, Hughes C, D'Arcy S, Taylor T, et al. A protocol for a randomised clinical trial of the effect of providing feedback on inhaler technique and adherence from an electronic device in patients with poorly controlled severe asthma. BMJ open. 2016;6(1):e009350. pmid:26729384
  42. 42. Sulaiman I, Greene G, MacHale E, Seheult J, Mokoka M, D'Arcy S, et al. A randomised clinical trial of feedback on inhaler adherence and technique in patients with severe uncontrolled asthma. European Respiratory Journal. 2018;51(1):1701126. pmid:29301919
  43. 43. Sulaiman I, Cushen B, Greene G, Seheult J, Seow D, Rawat F, et al. Objective assessment of adherence to inhalers by COPD Patients. American journal of respiratory and critical care medicine. 2016;(ja).
  44. 44. Sulaiman I, Seheult J, Sadasivuni N, Cushen B, Mokoka M, Costello R. Inhaler technique errors have an impact on drug delivery. A50 ASTHMA: OBSERVATIONAL STUDIES: Am Thoracic Soc; 2016. p. A1715-A.
  45. 45. Haberer JE, Kahane J, Kigozi I, Emenyonu N, Hunt P, Martin J, et al. Real-time adherence monitoring for HIV antiretroviral therapy. AIDS and Behavior. 2010;14(6):1340–6. pmid:20809380
  46. 46. Vashist SK, Schneider EM, Luong JH. Commercial smartphone-based devices and smart applications for personalized healthcare monitoring and management. Diagnostics. 2014;4(3):104–28. pmid:26852680
  47. 47. Checchi KD, Huybrechts KF, Avorn J, Kesselheim AS. Electronic medication packaging devices and medication adherence: a systematic review. Jama. 2014;312(12):1237–47. pmid:25247520
  48. 48. Heaney LG, Mcgarvey LP. Personalised Medicine for Asthma and Chronic Obstructive Pulmonary Disease. Respiration. 2017;93(3):153–61. pmid:28110335
  49. 49. Agusti A. The path to personalised medicine in COPD. Thorax. 2014;69(9):857–64. pmid:24781218
  50. 50. Collins FS, Varmus H. A new initiative on precision medicine. New England Journal of Medicine. 2015;372(9):793–5. pmid:25635347
  51. 51. Altshuler B. Modeling of dose-response relationships. Environmental health perspectives. 1981;42:23. pmid:7333256
  52. 52. Buchvald F, Eiberg H, Bisgaard H. Heterogeneity of FeNO response to inhaled steroid in asthmatic children. Clinical & Experimental Allergy. 2003;33(12):1735–40.
  53. 53. Cowan DC, Taylor DR, Peterson LE, Cowan JO, Palmay R, Williamson A, et al. Biomarker-based asthma phenotypes of corticosteroid response. Journal of allergy and clinical immunology. 2015;135(4):877–83. e1. pmid:25488689
  54. 54. Bisgaard H, Le Roux P, Bjåmer D, Dymek A, Vermeulen JH, Hultquist C. Budesonide/formoterol maintenance plus reliver therapy: A new strategy in pediatric asthma. Chest. 2006;130(6):1733–43. pmid:17166990
  55. 55. Bova CA, Fennie KP, Knafl GJ, Dieckhaus KD, Watrous E, Williams AB. Use of electronic monitoring devices to measure antiretroviral adherence: practical considerations. AIDS and Behavior. 2005;9(1):103–10. pmid:15812617
  56. 56. Chen C, Kehtarnavaz N, Jafari R, editors. A medication adherence monitoring system for pill bottles based on a wearable inertial sensor. Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE; 2014: IEEE.
  57. 57. de Bruin M, Hospers HJ, van Breukelen GJ, Kok G, Koevoets WM, Prins JM. Electronic monitoring-based counseling to enhance adherence among HIV-infected patients: a randomized controlled trial. Health Psychology. 2010;29(4):421. pmid:20658830
  58. 58. Farmer KC. Methods for measuring and monitoring medication regimen adherence in clinical trials and clinical practice. Clinical therapeutics. 1999;21(6):1074–90. pmid:10440628
  59. 59. Lee JK, Grace KA, Foster TG, Crawley MJ, Erowele GI, Sun HJ, et al. How should we measure medication adherence in clinical trials and practice? Therapeutics and clinical risk management. 2007;3(4):685. pmid:18472991
  60. 60. Ruppar TM, Dobbels F, Lewek P, Matyjaszczyk M, Siebens K, De Geest SM. Systematic review of clinical practice guidelines for the improvement of medication adherence. International journal of behavioral medicine. 2015;22(6):699–708. pmid:25805550
  61. 61. Vrijens B, Urquhart J. Methods for measuring, enhancing, and accounting for medication adherence in clinical trials. Clinical Pharmacology & Therapeutics. 2014;95(6):617–26.
  62. 62. Beasley R, Weatherall M, Shirtcliffe P, Hancox R, Reddel HK. Combination corticosteroid/β-agonist inhaler as reliever therapy: A solution for intermittent and mild asthma? Journal of Allergy and Clinical Immunology. 2014;133(1):39–41. doi: https://doi.org/https://doi.org/10.1016/j.jaci.2013.10.053. pmid:24369798