Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Research article

A comparison of estimators from self-controlled case series, case-crossover design, and sequence symmetry analysis for pharmacoepidemiological studies

Authors: Yoshinori Takeuchi, Tomohiro Shinozaki, Yutaka Matsuyama

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Background

Despite the frequent use of self-controlled methods in pharmacoepidemiological studies, the factors that may bias the estimates from these methods have not been adequately compared in real-world settings. Here, we comparatively examined the impact of a time-varying confounder and its interactions with time-invariant confounders, time trends in exposures and events, restrictions, and misspecification of risk period durations on the estimators from three self-controlled methods. This study analyzed self-controlled case series (SCCS), case-crossover (CCO) design, and sequence symmetry analysis (SSA) using simulated and actual electronic medical records datasets.

Methods

We evaluated the performance of the three self-controlled methods in simulated cohorts for the following scenarios: 1) time-invariant confounding with interactions between the confounders, 2) time-invariant and time-varying confounding without interactions, 3) time-invariant and time-varying confounding with interactions among the confounders, 4) time trends in exposures and events, 5) restricted follow-up time based on event occurrence, and 6) patient restriction based on event history. The sensitivity of the estimators to misspecified risk period durations was also evaluated. As a case study, we applied these methods to evaluate the risk of macrolides on liver injury using electronic medical records.

Results

In the simulation analysis, time-varying confounding produced bias in the SCCS and CCO design estimates, which aggravated in the presence of interactions between the time-invariant and time-varying confounders. The SCCS estimates were biased by time trends in both exposures and events. Erroneously short risk periods introduced bias to the CCO design estimate, whereas erroneously long risk periods introduced bias to the estimates of all three methods. Restricting the follow-up time led to severe bias in the SSA estimates. The SCCS estimates were sensitive to patient restriction. The case study showed that although macrolide use was significantly associated with increased liver injury occurrence in all methods, the value of the estimates varied.

Conclusions

The estimations of the three self-controlled methods depended on various underlying assumptions, and the violation of these assumptions may cause non-negligible bias in the resulting estimates. Pharmacoepidemiologists should select the appropriate self-controlled method based on how well the relevant key assumptions are satisfied with respect to the available data.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hallas J, Pottegard A. Use of self-controlled designs in pharmacoepidemiology. J Intern Med. 2014;275(6):581–9.CrossRefPubMed Hallas J, Pottegard A. Use of self-controlled designs in pharmacoepidemiology. J Intern Med. 2014;275(6):581–9.CrossRefPubMed
2.
go back to reference Maclure M, Fireman B, Nelson JC, Hua W, Shoaibi A, Paredes A, Madigan D. When should case-only designs be used for safety monitoring of medical products? Pharmacoepidemiol Drug Saf. 2012;21(Suppl 1):50–61.CrossRefPubMed Maclure M, Fireman B, Nelson JC, Hua W, Shoaibi A, Paredes A, Madigan D. When should case-only designs be used for safety monitoring of medical products? Pharmacoepidemiol Drug Saf. 2012;21(Suppl 1):50–61.CrossRefPubMed
3.
go back to reference Uddin MJ, Groenwold RH, Ali MS, de Boer A, Roes KC, Chowdhury MA, Klungel OH. Methods to control for unmeasured confounding in pharmacoepidemiology: an overview. Int J Clin Pharm. 2016;38(3):714–23.PubMed Uddin MJ, Groenwold RH, Ali MS, de Boer A, Roes KC, Chowdhury MA, Klungel OH. Methods to control for unmeasured confounding in pharmacoepidemiology: an overview. Int J Clin Pharm. 2016;38(3):714–23.PubMed
4.
go back to reference Lai CL, Kuo RN, Chen HM, Chen MF, Chan KA, Lai MS. Risk of hip/femur fractures during the initiation period of alpha-adrenoceptor blocker therapy among elderly males: a self-controlled case series study. Br J Clin Pharmacol. 2015;80(5):1208–18.CrossRefPubMedPubMedCentral Lai CL, Kuo RN, Chen HM, Chen MF, Chan KA, Lai MS. Risk of hip/femur fractures during the initiation period of alpha-adrenoceptor blocker therapy among elderly males: a self-controlled case series study. Br J Clin Pharmacol. 2015;80(5):1208–18.CrossRefPubMedPubMedCentral
5.
go back to reference Pratt NL, Ramsay EN, Kemp A, Kalisch-Ellett LM, Shakib S, Caughey GE, Ryan P, Graves S, Roughead EE. Ranibizumab and risk of hospitalisation for ischaemic stroke and myocardial infarction in patients with age-related macular degeneration: a self-controlled case-series analysis. Drug Saf. 2014;37(12):1021–7.CrossRefPubMedPubMedCentral Pratt NL, Ramsay EN, Kemp A, Kalisch-Ellett LM, Shakib S, Caughey GE, Ryan P, Graves S, Roughead EE. Ranibizumab and risk of hospitalisation for ischaemic stroke and myocardial infarction in patients with age-related macular degeneration: a self-controlled case-series analysis. Drug Saf. 2014;37(12):1021–7.CrossRefPubMedPubMedCentral
6.
go back to reference Campbell UB, Walker AM, Gaffney M, Petronis KR, Creanga D, Quinn S, Klein BE, Laties AM, Lewis M, Sharlip ID, et al. Acute nonarteritic anterior ischemic optic neuropathy and exposure to phosphodiesterase type 5 inhibitors. J Sex Med. 2015;12(1):139–51.CrossRefPubMed Campbell UB, Walker AM, Gaffney M, Petronis KR, Creanga D, Quinn S, Klein BE, Laties AM, Lewis M, Sharlip ID, et al. Acute nonarteritic anterior ischemic optic neuropathy and exposure to phosphodiesterase type 5 inhibitors. J Sex Med. 2015;12(1):139–51.CrossRefPubMed
7.
go back to reference Lee CH, Wang JD, Chen PC. Health data analysis in Taiwan research G. Case-crossover design: an alternative strategy for detecting drug-induced liver injury. J Clin Epidemiol. 2012;65(5):560–7.CrossRefPubMed Lee CH, Wang JD, Chen PC. Health data analysis in Taiwan research G. Case-crossover design: an alternative strategy for detecting drug-induced liver injury. J Clin Epidemiol. 2012;65(5):560–7.CrossRefPubMed
8.
go back to reference Takeuchi Y, Kajiyama K, Ishiguro C, Uyama Y. Atypical antipsychotics and the risk of Hyperlipidemia: a sequence symmetry analysis. Drug Saf. 2015;38(7):641–50.CrossRefPubMed Takeuchi Y, Kajiyama K, Ishiguro C, Uyama Y. Atypical antipsychotics and the risk of Hyperlipidemia: a sequence symmetry analysis. Drug Saf. 2015;38(7):641–50.CrossRefPubMed
9.
go back to reference Rasmussen L, Hallas J, Madsen KG, Pottegard A. Cardiovascular drugs and erectile dysfunction - a symmetry analysis. Br J Clin Pharmacol. 2015;80(5):1219–23.CrossRefPubMedPubMedCentral Rasmussen L, Hallas J, Madsen KG, Pottegard A. Cardiovascular drugs and erectile dysfunction - a symmetry analysis. Br J Clin Pharmacol. 2015;80(5):1219–23.CrossRefPubMedPubMedCentral
10.
go back to reference Gault N, Castaneda-Sanabria J, De Rycke Y, Guillo S, Foulon S, Tubach F. Self-controlled designs in pharmacoepidemiology involving electronic healthcare databases: a systematic review. BMC Med Res Methodol. 2017;17(1):25.CrossRefPubMedPubMedCentral Gault N, Castaneda-Sanabria J, De Rycke Y, Guillo S, Foulon S, Tubach F. Self-controlled designs in pharmacoepidemiology involving electronic healthcare databases: a systematic review. BMC Med Res Methodol. 2017;17(1):25.CrossRefPubMedPubMedCentral
11.
go back to reference Whitaker HJ, Farrington CP, Spiessens B, Musonda P. Tutorial in biostatistics: the self-controlled case series method. Stat Med. 2006;25(10):1768–97.CrossRefPubMed Whitaker HJ, Farrington CP, Spiessens B, Musonda P. Tutorial in biostatistics: the self-controlled case series method. Stat Med. 2006;25(10):1768–97.CrossRefPubMed
12.
go back to reference Musonda P, Hocine MN, Whitaker HJ, Farrington CP. Self-controlled case series analyses: small-sample performance. Comput Stat Data Anal. 2008;52(4):1942–57.CrossRef Musonda P, Hocine MN, Whitaker HJ, Farrington CP. Self-controlled case series analyses: small-sample performance. Comput Stat Data Anal. 2008;52(4):1942–57.CrossRef
13.
go back to reference Hua W, Sun G, Dodd CN, Romio SA, Whitaker HJ, Izurieta HS, Black S, Sturkenboom MC, Davis RL, Deceuninck G, et al. A simulation study to compare three self-controlled case series approaches: correction for violation of assumption and evaluation of bias. Pharmacoepidemiol Drug Saf. 2013;22(8):819–25.CrossRefPubMed Hua W, Sun G, Dodd CN, Romio SA, Whitaker HJ, Izurieta HS, Black S, Sturkenboom MC, Davis RL, Deceuninck G, et al. A simulation study to compare three self-controlled case series approaches: correction for violation of assumption and evaluation of bias. Pharmacoepidemiol Drug Saf. 2013;22(8):819–25.CrossRefPubMed
14.
go back to reference Farrington CP, Whitaker HJ. Semiparametric analysis of case series data. J R Stat Soc Ser C Appl Stat. 2006;55(5):553–94.CrossRef Farrington CP, Whitaker HJ. Semiparametric analysis of case series data. J R Stat Soc Ser C Appl Stat. 2006;55(5):553–94.CrossRef
15.
go back to reference Maclure M. The case-crossover design: a method for studying transient effects on the risk of acute events. Am J Epidemiol. 1991;133(2):144–53.CrossRefPubMed Maclure M. The case-crossover design: a method for studying transient effects on the risk of acute events. Am J Epidemiol. 1991;133(2):144–53.CrossRefPubMed
16.
go back to reference Greenland S. Confounding and exposure trends in case-crossover and case-time-control designs. Epidemiology. 1996;7(3):231–9.CrossRefPubMed Greenland S. Confounding and exposure trends in case-crossover and case-time-control designs. Epidemiology. 1996;7(3):231–9.CrossRefPubMed
17.
go back to reference Vines SK, Farrington CP. Within-subject exposure dependency in case-crossover studies. Stat Med. 2001;20(20):3039–49.CrossRefPubMed Vines SK, Farrington CP. Within-subject exposure dependency in case-crossover studies. Stat Med. 2001;20(20):3039–49.CrossRefPubMed
18.
go back to reference Hallas J. Evidence of depression provoked by cardiovascular medication: a prescription sequence symmetry analysis. Epidemiology. 1996;7(5):478–84.CrossRefPubMed Hallas J. Evidence of depression provoked by cardiovascular medication: a prescription sequence symmetry analysis. Epidemiology. 1996;7(5):478–84.CrossRefPubMed
19.
go back to reference Pratt NL, Ilomaki J, Raymond C, Roughead EE. The performance of sequence symmetry analysis as a tool for post-market surveillance of newly marketed medicines: a simulation study. BMC Med Res Methodol. 2014;14:66.CrossRefPubMedPubMedCentral Pratt NL, Ilomaki J, Raymond C, Roughead EE. The performance of sequence symmetry analysis as a tool for post-market surveillance of newly marketed medicines: a simulation study. BMC Med Res Methodol. 2014;14:66.CrossRefPubMedPubMedCentral
20.
go back to reference Tsiropoulos I, Andersen M, Hallas J. Adverse events with use of antiepileptic drugs: a prescription and event symmetry analysis. Pharmacoepidemiol Drug Saf. 2009;18(6):483–91.CrossRefPubMed Tsiropoulos I, Andersen M, Hallas J. Adverse events with use of antiepileptic drugs: a prescription and event symmetry analysis. Pharmacoepidemiol Drug Saf. 2009;18(6):483–91.CrossRefPubMed
22.
go back to reference Wang SV, Coull BA, Schwartz J, Mittleman MA, Wellenius GA. Potential for bias in case-crossover studies with shared exposures analyzed using SAS. Am J Epidemiol. 2011;174(1):118–24.CrossRefPubMedPubMedCentral Wang SV, Coull BA, Schwartz J, Mittleman MA, Wellenius GA. Potential for bias in case-crossover studies with shared exposures analyzed using SAS. Am J Epidemiol. 2011;174(1):118–24.CrossRefPubMedPubMedCentral
23.
go back to reference Benichou C. Criteria of drug-induced liver disorders. Report of an international consensus meeting. J Hepatol. 1990;11(2):272–6.CrossRefPubMed Benichou C. Criteria of drug-induced liver disorders. Report of an international consensus meeting. J Hepatol. 1990;11(2):272–6.CrossRefPubMed
24.
go back to reference Sarges P, Steinberg JM, Lewis JH. Drug-induced liver injury: highlights from a review of the 2015 literature. Drug Saf. 2016;39(9):801–21.CrossRefPubMed Sarges P, Steinberg JM, Lewis JH. Drug-induced liver injury: highlights from a review of the 2015 literature. Drug Saf. 2016;39(9):801–21.CrossRefPubMed
25.
go back to reference Stine JG, Lewis JH. Hepatotoxicity of antibiotics: a review and update for the clinician. Clin Liver Dis. 2013;17(4):609–42. ixCrossRefPubMed Stine JG, Lewis JH. Hepatotoxicity of antibiotics: a review and update for the clinician. Clin Liver Dis. 2013;17(4):609–42. ixCrossRefPubMed
Metadata
Title
A comparison of estimators from self-controlled case series, case-crossover design, and sequence symmetry analysis for pharmacoepidemiological studies
Authors
Yoshinori Takeuchi
Tomohiro Shinozaki
Yutaka Matsuyama
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0457-7

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue