Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Self-controlled designs in pharmacoepidemiology involving electronic healthcare databases: a systematic review

Authors: Nathalie Gault, Johann Castañeda-Sanabria, Yann De Rycke, Sylvie Guillo, Stéphanie Foulon, Florence Tubach

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Observational studies are widely used in pharmacoepidemiology. Several designs can be used, in particular self-controlled designs (case-crossover and self-controlled case series). These designs offer the advantage of controlling for time-invariant confounders, which may not be collected in electronic healthcare databases. They are particularly useful in pharmacoepidemiology involving healthcare database. To be valid, they require the presence of some characteristics (key validity assumptions), and in such situations, these designs should be preferred. We aimed at describing the appropriate use and reporting of the key validity assumptions in self-controlled design studies.

Methods

Articles published between January 2011 and December 2014, and describing a self-controlled study design involving electronic healthcare databases were retrieved. The appropriate use (fulfilment of key assumptions) was studied in terms of major (abrupt onset event, rare or recurrent event, and intermittent exposure) and minor assumptions (those for which the design can be adapted).

Results

Among the 107 articles describing a self-controlled design, 35/53 (66%) case-crossover studies, and 48/55 (87%) self-controlled case series fulfilled the major validity assumptions for use of the design; 4/35 and 14/48 respectively did not fulfill the minor assumptions. Overall, 31/53 (58%) case-crossover studies and 34/55 (62%) self-controlled case series fulfilled both major and minor assumptions. The reporting of the methodology or the results was appropriate, except for power calculation.

Conclusions

Self-controlled designs were not appropriately used in34% and 13% of the articles we reviewed that described a case-crossover or a self-controlled case series design, respectively. We encourage better use of these designs in situations in which major validity assumptions are fulfilled (i.e., for which they are recommended), accounting for situations for which the design can be adapted.
Appendix
Available only for authorised users
Footnotes
1
In some articles of self-controlled case series, the risk period was defined arbitrarily in the same way for all patients without accounting for the actual duration of prescription. For drugs used chronically, this situation can result in misclassification bias, because the subject is considered unexposed when a prescription period was still ongoing. Such exposures were considered sustained and the design was considered as inappropriate in these situations. In contrast, when risk period was equal to the prescription period and when the observation period was large enough to observe a switch in exposure status, we considered the exposure as transient even if it was used chronically
 
Literature
1.
go back to reference Strom BL. What is pharmacoepidemiology? In: Strom BL, editor. Pharmacoepidemiology, vol. 6. 4th ed. Chichester, West Sussex: John Wiley & Sons; 2005. p. 3–15. Strom BL. What is pharmacoepidemiology? In: Strom BL, editor. Pharmacoepidemiology, vol. 6. 4th ed. Chichester, West Sussex: John Wiley & Sons; 2005. p. 3–15.
2.
go back to reference Strom BL. Overview of automated databases in phamacoepidemiology. In: Strom BL, editor. Pharamcoepidemiology. 4th ed. Chichester, West Sussex: John Wiley & Sons; 2005. p. 219–22. Strom BL. Overview of automated databases in phamacoepidemiology. In: Strom BL, editor. Pharamcoepidemiology. 4th ed. Chichester, West Sussex: John Wiley & Sons; 2005. p. 219–22.
3.
go back to reference Schneeweiss S, Avorn J. A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol. 2005;58(4):323–37.CrossRefPubMed Schneeweiss S, Avorn J. A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol. 2005;58(4):323–37.CrossRefPubMed
4.
go back to reference Gagne JJ, Fireman B, Ryan PB, Maclure M, Gerhard T, Toh S, Rassen JA, Nelson JC, Schneeweiss S. Design considerations in an active medical product safety monitoring system. Pharmacoepidemiol Drug Saf. 2012;21 Suppl 1:32–40.CrossRefPubMed Gagne JJ, Fireman B, Ryan PB, Maclure M, Gerhard T, Toh S, Rassen JA, Nelson JC, Schneeweiss S. Design considerations in an active medical product safety monitoring system. Pharmacoepidemiol Drug Saf. 2012;21 Suppl 1:32–40.CrossRefPubMed
5.
go back to reference Maclure M, Fireman B, Nelson JC, Hua W, Shoaibi A, Paredes A, Madigan D. When should case-only designs be used for safety monitoring of medical products? Pharmacoepidemiol Drug Saf. 2012;21 Suppl 1:50–61.CrossRefPubMed Maclure M, Fireman B, Nelson JC, Hua W, Shoaibi A, Paredes A, Madigan D. When should case-only designs be used for safety monitoring of medical products? Pharmacoepidemiol Drug Saf. 2012;21 Suppl 1:50–61.CrossRefPubMed
6.
go back to reference Nordmann S, Biard L, Ravaud P, Esposito-Farese M, Tubach F. Case-only designs in pharmacoepidemiology: a systematic review. PLoS One. 2012;7(11):e49444.CrossRefPubMedPubMedCentral Nordmann S, Biard L, Ravaud P, Esposito-Farese M, Tubach F. Case-only designs in pharmacoepidemiology: a systematic review. PLoS One. 2012;7(11):e49444.CrossRefPubMedPubMedCentral
7.
go back to reference Maclure M. The case-crossover design: a method for studying transient effects on the risk of acute events. Am J Epidemiol. 1991;133(2):144–53.PubMed Maclure M. The case-crossover design: a method for studying transient effects on the risk of acute events. Am J Epidemiol. 1991;133(2):144–53.PubMed
8.
go back to reference Maclure M, Mittleman MA. Should we use a case-crossover design? Annu Rev Publ Health. 2000;21:193–221.CrossRef Maclure M, Mittleman MA. Should we use a case-crossover design? Annu Rev Publ Health. 2000;21:193–221.CrossRef
9.
go back to reference Farrington CP. Relative incidence estimation from case series for vaccine safety evaluation. Biometrics. 1995;51(1):228–35.CrossRefPubMed Farrington CP. Relative incidence estimation from case series for vaccine safety evaluation. Biometrics. 1995;51(1):228–35.CrossRefPubMed
10.
go back to reference Whitaker HJ, Farrington CP, Spiessens B, Musonda P. Tutorial in biostatistics: the self-controlled case series method. Stat Med. 2006;25(10):1768–97.CrossRefPubMed Whitaker HJ, Farrington CP, Spiessens B, Musonda P. Tutorial in biostatistics: the self-controlled case series method. Stat Med. 2006;25(10):1768–97.CrossRefPubMed
11.
go back to reference Whitaker HJ, Hocine MN, Farrington CP. The methodology of self-controlled case series studies. Stat Methods Med Res. 2009;18(1):7–26.CrossRefPubMed Whitaker HJ, Hocine MN, Farrington CP. The methodology of self-controlled case series studies. Stat Methods Med Res. 2009;18(1):7–26.CrossRefPubMed
12.
13.
go back to reference Redelmeier DA, Tibshirani RJ. Association between cellular-telephone calls and motor vehicle collisions. N Engl J Med. 1997;336(7):453–8.CrossRefPubMed Redelmeier DA, Tibshirani RJ. Association between cellular-telephone calls and motor vehicle collisions. N Engl J Med. 1997;336(7):453–8.CrossRefPubMed
15.
go back to reference Suissa S. The case-time-control design: further assumptions and conditions. Epidemiology. 1998;9(4):441–5.CrossRefPubMed Suissa S. The case-time-control design: further assumptions and conditions. Epidemiology. 1998;9(4):441–5.CrossRefPubMed
16.
go back to reference Farrington CP, Whitaker HJ, Hocine MN. Case series analysis for censored, perturbed, or curtailed post-event exposures. Biostatistics. 2009;10(1):3–16.CrossRefPubMed Farrington CP, Whitaker HJ, Hocine MN. Case series analysis for censored, perturbed, or curtailed post-event exposures. Biostatistics. 2009;10(1):3–16.CrossRefPubMed
17.
go back to reference Kuhnert R, Hecker H, Poethko-Muller C, Schlaud M, Vennemann M, Whitaker HJ, Farrington CP. A modified self-controlled case series method to examine association between multidose vaccinations and death. Stat Med. 2011;30(6):666–77.CrossRefPubMed Kuhnert R, Hecker H, Poethko-Muller C, Schlaud M, Vennemann M, Whitaker HJ, Farrington CP. A modified self-controlled case series method to examine association between multidose vaccinations and death. Stat Med. 2011;30(6):666–77.CrossRefPubMed
18.
go back to reference Farrington CP, Hocine MN. Within-individual dependence in self-controlled case series models for recurrent events. J R Stat Soc C-Appl. 2010;59:457–75.CrossRef Farrington CP, Hocine MN. Within-individual dependence in self-controlled case series models for recurrent events. J R Stat Soc C-Appl. 2010;59:457–75.CrossRef
19.
go back to reference Farrington CP, Anaya-Izquierdo K, Whitaker HJ, Hocine MN, Douglas I, Smeeth L. Self-controlled case series analysis with event-dependent observation periods. J Am Stat Assoc. 2011;106(494):417–26.CrossRef Farrington CP, Anaya-Izquierdo K, Whitaker HJ, Hocine MN, Douglas I, Smeeth L. Self-controlled case series analysis with event-dependent observation periods. J Am Stat Assoc. 2011;106(494):417–26.CrossRef
20.
go back to reference Consiglio GP, Burden AM, Maclure M, McCarthy L, Cadarette SM. Case-crossover study design in pharmacoepidemiology: systematic review and recommendations. Pharmacoepidemiol Drug Saf. 2013;22(11):1146–53.CrossRefPubMed Consiglio GP, Burden AM, Maclure M, McCarthy L, Cadarette SM. Case-crossover study design in pharmacoepidemiology: systematic review and recommendations. Pharmacoepidemiol Drug Saf. 2013;22(11):1146–53.CrossRefPubMed
21.
go back to reference Weldeselassie YG, Whitaker H, Farrington CP. Use of the self-controlled case-series method in vaccine safety studies: review and recommendations for best practice. Epidemiol Infect. 2011;139(12):1805–17. doi: 10.1017/S0950268811001531. Weldeselassie YG, Whitaker H, Farrington CP. Use of the self-controlled case-series method in vaccine safety studies: review and recommendations for best practice. Epidemiol Infect. 2011;139(12):1805–17. doi: 10.​1017/​S095026881100153​1.
22.
go back to reference Gault N, Castaneda-Sanabria J, Guillo S, Foulon S, Tubach F. Underuse of self-controlled designs in pharmacoepidemiology in electronic healthcare databases: a systematic review. Pharmacoepidemiol Drug Saf. 2016;25(4):372–7.CrossRefPubMed Gault N, Castaneda-Sanabria J, Guillo S, Foulon S, Tubach F. Underuse of self-controlled designs in pharmacoepidemiology in electronic healthcare databases: a systematic review. Pharmacoepidemiol Drug Saf. 2016;25(4):372–7.CrossRefPubMed
23.
go back to reference von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, Initiative S. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7.CrossRef von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, Initiative S. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7.CrossRef
24.
go back to reference Navidi W. Bidirectional case-crossover designs for exposures with time trends. Biometrics. 1998;54(2):596–605.CrossRefPubMed Navidi W. Bidirectional case-crossover designs for exposures with time trends. Biometrics. 1998;54(2):596–605.CrossRefPubMed
25.
go back to reference Wang S, Linkletter C, Maclure M, Dore D, Mor V, Buka S, Wellenius GA. Future cases as present controls to adjust for exposure trend bias in case-only studies. Epidemiology. 2011;22(4):568–74.CrossRefPubMedPubMedCentral Wang S, Linkletter C, Maclure M, Dore D, Mor V, Buka S, Wellenius GA. Future cases as present controls to adjust for exposure trend bias in case-only studies. Epidemiology. 2011;22(4):568–74.CrossRefPubMedPubMedCentral
26.
go back to reference Farrington P, Pugh S, Colville A, Flower A, Nash J, Morgan-Capner P, Rush M, Miller E. A new method for active surveillance of adverse events from diphtheria/tetanus/pertussis and measles/mumps/rubella vaccines. Lancet. 1995;345(8949):567–9.CrossRefPubMed Farrington P, Pugh S, Colville A, Flower A, Nash J, Morgan-Capner P, Rush M, Miller E. A new method for active surveillance of adverse events from diphtheria/tetanus/pertussis and measles/mumps/rubella vaccines. Lancet. 1995;345(8949):567–9.CrossRefPubMed
27.
go back to reference Luo X, Sorock GS. Analysis of recurrent event data under the case-crossover design with applications to elderly falls. Stat Med. 2008;27(15):2890–901.CrossRefPubMed Luo X, Sorock GS. Analysis of recurrent event data under the case-crossover design with applications to elderly falls. Stat Med. 2008;27(15):2890–901.CrossRefPubMed
28.
go back to reference Wang PS, Schneeweiss S, Glynn RJ, Mogun H, Avorn J. Use of the case-crossover design to study prolonged drug exposures and insidious outcomes. Ann Epidemiol. 2004;14(4):296–303.CrossRefPubMed Wang PS, Schneeweiss S, Glynn RJ, Mogun H, Avorn J. Use of the case-crossover design to study prolonged drug exposures and insidious outcomes. Ann Epidemiol. 2004;14(4):296–303.CrossRefPubMed
29.
go back to reference Armstrong BG, Gasparrini A, Tobias A. Conditional Poisson models: a flexible alternative to conditional logistic case cross-over analysis. BMC Med Res Methodol. 2014;14:122.CrossRefPubMedPubMedCentral Armstrong BG, Gasparrini A, Tobias A. Conditional Poisson models: a flexible alternative to conditional logistic case cross-over analysis. BMC Med Res Methodol. 2014;14:122.CrossRefPubMedPubMedCentral
30.
go back to reference Pouwels KB, Mulder B, Hak E. Moderate concordance was found between case-only and parallel group designs in systematic comparison. J Clin Epidemiol. 2016;71:18–24.CrossRefPubMed Pouwels KB, Mulder B, Hak E. Moderate concordance was found between case-only and parallel group designs in systematic comparison. J Clin Epidemiol. 2016;71:18–24.CrossRefPubMed
31.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.CrossRefPubMedPubMedCentral
32.
go back to reference van Staa T-P, Abenhaim L, Leufkens HGM. A study of the effects of exposure misclassification due to the time-window design in pharmacoepidemiologic studies. J Clin Epidemiol. 1994;47(2):183–9.CrossRefPubMed van Staa T-P, Abenhaim L, Leufkens HGM. A study of the effects of exposure misclassification due to the time-window design in pharmacoepidemiologic studies. J Clin Epidemiol. 1994;47(2):183–9.CrossRefPubMed
33.
go back to reference Schuemie MJ, Trifiro G, Coloma PM, Ryan PB, Madigan D. Detecting adverse drug reactions following long-term exposure in longitudinal observational data: The exposure-adjusted self-controlled case series. Stat Methods Med Res. 2016;25(6):2577–2592. doi: 10.1177/0962280214527531. Schuemie MJ, Trifiro G, Coloma PM, Ryan PB, Madigan D. Detecting adverse drug reactions following long-term exposure in longitudinal observational data: The exposure-adjusted self-controlled case series. Stat Methods Med Res. 2016;25(6):2577–2592. doi: 10.​1177/​0962280214527531​.
34.
go back to reference Wang SV, Schneeweiss S, Maclure M, Gagne JJ. “First-wave” bias when conducting active safety monitoring of newly marketed medications with outcome-indexed self-controlled designs. Am J Epidemiol. 2014;180(6):636–44.CrossRefPubMedPubMedCentral Wang SV, Schneeweiss S, Maclure M, Gagne JJ. “First-wave” bias when conducting active safety monitoring of newly marketed medications with outcome-indexed self-controlled designs. Am J Epidemiol. 2014;180(6):636–44.CrossRefPubMedPubMedCentral
35.
go back to reference Hua W, Sun G, Dodd CN, Romio SA, Whitaker HJ, Izurieta HS, Black S, Sturkenboom MCJM, Davis RL, Deceuninck G, et al. A simulation study to compare three self-controlled case series approaches: correction for violation of assumption and evaluation of bias. Pharmacoepidemiol Drug Saf. 2013;22(8):819–25.CrossRefPubMed Hua W, Sun G, Dodd CN, Romio SA, Whitaker HJ, Izurieta HS, Black S, Sturkenboom MCJM, Davis RL, Deceuninck G, et al. A simulation study to compare three self-controlled case series approaches: correction for violation of assumption and evaluation of bias. Pharmacoepidemiol Drug Saf. 2013;22(8):819–25.CrossRefPubMed
36.
go back to reference Jensen AK, Gerds TA, Weeke P, Torp-Pedersen C, Andersen PK. On the validity of the case-time-control design for autocorrelated exposure histories. Epidemiology. 2014;25(1):110–3.CrossRefPubMed Jensen AK, Gerds TA, Weeke P, Torp-Pedersen C, Andersen PK. On the validity of the case-time-control design for autocorrelated exposure histories. Epidemiology. 2014;25(1):110–3.CrossRefPubMed
37.
go back to reference Simpson SE, Madigan D, Zorych I, Schuemie MJ, Ryan PB, Suchard MA. Multiple self-controlled case series for large-scale longitudinal observational databases. Biometrics. 2013;69(4):893–902.CrossRefPubMed Simpson SE, Madigan D, Zorych I, Schuemie MJ, Ryan PB, Suchard MA. Multiple self-controlled case series for large-scale longitudinal observational databases. Biometrics. 2013;69(4):893–902.CrossRefPubMed
38.
go back to reference Maclure M. ‘Why me?’ versus ‘why now?’ Differences between operational hypotheses in case–control versus case-crossover studies. Pharmacoepidemiol Drug Saf. 2007;16(8):850–3.CrossRefPubMed Maclure M. ‘Why me?’ versus ‘why now?’ Differences between operational hypotheses in case–control versus case-crossover studies. Pharmacoepidemiol Drug Saf. 2007;16(8):850–3.CrossRefPubMed
39.
go back to reference Carnahan RM, Moores KG. Mini-Sentinel’s systematic reviews of validated methods for identifying health outcomes using administrative and claims data: methods and lessons learned. Pharmacoepidemiol Drug Saf. 2012;21(S1):82–9.CrossRefPubMed Carnahan RM, Moores KG. Mini-Sentinel’s systematic reviews of validated methods for identifying health outcomes using administrative and claims data: methods and lessons learned. Pharmacoepidemiol Drug Saf. 2012;21(S1):82–9.CrossRefPubMed
40.
go back to reference Murdoch TB, Detsky AS. The inevitable application of big data to health care. JAMA. 2013;309(13):1351–2.CrossRefPubMed Murdoch TB, Detsky AS. The inevitable application of big data to health care. JAMA. 2013;309(13):1351–2.CrossRefPubMed
Metadata
Title
Self-controlled designs in pharmacoepidemiology involving electronic healthcare databases: a systematic review
Authors
Nathalie Gault
Johann Castañeda-Sanabria
Yann De Rycke
Sylvie Guillo
Stéphanie Foulon
Florence Tubach
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0278-0

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue