Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

Adjusting for geographic variation in observational comparative effectiveness studies: a case study of antipsychotics using state Medicaid data

Authors: Elisabeth Dowling Root, Deborah SK Thomas, Elizabeth J Campagna, Elaine H Morrato

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

Area-level variation in treatment and outcomes may be a potential source of confounding bias in observational comparative effectiveness studies. This paper demonstrates how to use exploratory spatial data analysis (ESDA) and spatial statistical methods to investigate and control for these potential biases. The case presented compares the effectiveness of two antipsychotic treatment strategies: oral second-generation antipsychotics (SGAs) vs. long-acting paliperiodone palmitate (PP).

Methods

A new-start cohort study was conducted analyzing patient-level administrative claims data (8/1/2008–4/30/2011) from Missouri Medicaid. ESDA techniques were used to examine spatial patterns of antipsychotic prescriptions and outcomes (hospitalization and emergency department (ED) visits). Likelihood of mental health-related outcomes were compared between patients starting PP (N = 295) and oral SGAs (N = 8,626) using multilevel logistic regression models adjusting for patient composition (demographic and clinical factors) and geographic region.

Results

ESDA indicated significant spatial variation in antipsychotic prescription patterns and moderate variation in hospitalization and ED visits thereby indicating possible confounding by geography. In the multilevel models for this antipsychotic case example, patient composition represented a stronger source of confounding than geographic context.

Conclusion

Because geographic variation in health care delivery is ubiquitous, it could be a comparative effectiveness research (CER) best practice to test for possible geographic confounding in observational data. Though the magnitude of the area-level geography effects were small in this case, they were still statistically significant and should therefore be examined as part of this observational CER study. More research is needed to better estimate the range of confounding due to geography across different types of observational comparative effectiveness studies and healthcare utilization outcomes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Velentgas P, Dreyer N, Nourjah P, Smith S, Torchia M: Developing a Protocol for Observational Comparative Effectiveness Research: A User's Guide. AHRQ Publication No 12(13)-EHC099. 2013, Rockville, MD: Agency for Healthcare Research and Quality Velentgas P, Dreyer N, Nourjah P, Smith S, Torchia M: Developing a Protocol for Observational Comparative Effectiveness Research: A User's Guide. AHRQ Publication No 12(13)-EHC099. 2013, Rockville, MD: Agency for Healthcare Research and Quality
3.
go back to reference Folland S, Stano M: Sources of small area variations in the use of medical care. J Health Econ. 1989, 8 (1): 85-107. 10.1016/0167-6296(89)90010-6.CrossRefPubMed Folland S, Stano M: Sources of small area variations in the use of medical care. J Health Econ. 1989, 8 (1): 85-107. 10.1016/0167-6296(89)90010-6.CrossRefPubMed
4.
go back to reference Wennberg J, Gittelsohn A: Variations in medical care among small areas. Sci Am. 1982, 246 (4): 120-134. 10.1038/scientificamerican0482-120.CrossRefPubMed Wennberg J, Gittelsohn A: Variations in medical care among small areas. Sci Am. 1982, 246 (4): 120-134. 10.1038/scientificamerican0482-120.CrossRefPubMed
5.
go back to reference Kawachi I, Berkman LF: Neighborhoods and health. 2003, Oxford; New York: Oxford University PressCrossRef Kawachi I, Berkman LF: Neighborhoods and health. 2003, Oxford; New York: Oxford University PressCrossRef
6.
go back to reference Ricketts R, Savitz L, Gesler W: Geographic Methods in Health Services Research. 1994, Lanham, MD: University Press of America Ricketts R, Savitz L, Gesler W: Geographic Methods in Health Services Research. 1994, Lanham, MD: University Press of America
7.
go back to reference Song Y, Skinner J, Bynum J, Sutherland J, Wennberg JE, Fisher ES: Regional variations in diagnostic practices. N Engl J Med. 2010, 363 (1): 45-53. 10.1056/NEJMsa0910881.CrossRefPubMedPubMedCentral Song Y, Skinner J, Bynum J, Sutherland J, Wennberg JE, Fisher ES: Regional variations in diagnostic practices. N Engl J Med. 2010, 363 (1): 45-53. 10.1056/NEJMsa0910881.CrossRefPubMedPubMedCentral
8.
go back to reference Dartmouth Medical School. Center for the Evaluative Clinical Sciences, American Hospital Association, Center for Health Care Leadership: The Dartmouth atlas of health care. 1996, Chicago, IL: AHA Press Dartmouth Medical School. Center for the Evaluative Clinical Sciences, American Hospital Association, Center for Health Care Leadership: The Dartmouth atlas of health care. 1996, Chicago, IL: AHA Press
9.
go back to reference Dartmouth Medical School, Center for the Evaluative Clinical Sciences, Maine Medical Center, Center for Outcomes Research and Evaluation: The Dartmouth atlas of cardiovascular health care. 1999, Chicago, IL: AHA Press Dartmouth Medical School, Center for the Evaluative Clinical Sciences, Maine Medical Center, Center for Outcomes Research and Evaluation: The Dartmouth atlas of cardiovascular health care. 1999, Chicago, IL: AHA Press
10.
go back to reference Dartmouth Medical School. Center for the Evaluative Clinical Sciences., Maine Medical Center, Center for Outcomes Research and Evaluation: The Dartmouth atlas of musculoskeletal health care. 2000, Chicago, IL: AHA Press Dartmouth Medical School. Center for the Evaluative Clinical Sciences., Maine Medical Center, Center for Outcomes Research and Evaluation: The Dartmouth atlas of musculoskeletal health care. 2000, Chicago, IL: AHA Press
11.
go back to reference Pickle L, Mungiole M, Jones G, White A: Atlas of United States mortality. 1996, Hyattsville, MD: National Center for Health Statistics Pickle L, Mungiole M, Jones G, White A: Atlas of United States mortality. 1996, Hyattsville, MD: National Center for Health Statistics
13.
go back to reference Cooper MM: The Dartmouth Atlas of Health Care: what is it telling us?. Health Syst Rev. 1996, 29 (3): 44-45. 47PubMed Cooper MM: The Dartmouth Atlas of Health Care: what is it telling us?. Health Syst Rev. 1996, 29 (3): 44-45. 47PubMed
14.
go back to reference Fang G, Brooks JM, Chrischilles EA: A new method to isolate local-area practice styles in prescription use as the basis for instrumental variables in comparative effectiveness research. Med Care. 2010, 48 (8): 710-717. 10.1097/MLR.0b013e3181e41bb2.CrossRefPubMed Fang G, Brooks JM, Chrischilles EA: A new method to isolate local-area practice styles in prescription use as the basis for instrumental variables in comparative effectiveness research. Med Care. 2010, 48 (8): 710-717. 10.1097/MLR.0b013e3181e41bb2.CrossRefPubMed
15.
16.
go back to reference Brookhart MA, Rassen JA, Wang PS, Dormuth C, Mogun H, Schneeweiss S: Evaluating the validity of an instrumental variable study of neuroleptics: can between-physician differences in prescribing patterns be used to estimate treatment effects?. Med Care. 2007, 45 (10 Supl 2): S116-S122.CrossRefPubMed Brookhart MA, Rassen JA, Wang PS, Dormuth C, Mogun H, Schneeweiss S: Evaluating the validity of an instrumental variable study of neuroleptics: can between-physician differences in prescribing patterns be used to estimate treatment effects?. Med Care. 2007, 45 (10 Supl 2): S116-S122.CrossRefPubMed
17.
go back to reference Phelan JC, Link BG, Tehranifar P: Social conditions as fundamental causes of health inequalities: theory, evidence, and policy implications. J Health Soc Behav. 2010, 51 (Suppl): S28-S40.CrossRefPubMed Phelan JC, Link BG, Tehranifar P: Social conditions as fundamental causes of health inequalities: theory, evidence, and policy implications. J Health Soc Behav. 2010, 51 (Suppl): S28-S40.CrossRefPubMed
18.
go back to reference Sampson R, Morenoff J, Gannon-Rowley T: Assessing "neighborhood effects": Social processes and new directions in research. Annu Rev Sociol. 2002, 28: 443-478. 10.1146/annurev.soc.28.110601.141114.CrossRef Sampson R, Morenoff J, Gannon-Rowley T: Assessing "neighborhood effects": Social processes and new directions in research. Annu Rev Sociol. 2002, 28: 443-478. 10.1146/annurev.soc.28.110601.141114.CrossRef
19.
go back to reference Oakes J, Rossi P: The measurement of SES in health research: current practice and steps toward a new approach. Soc Sci Med. 2003, 56 (4): 769-784. 10.1016/S0277-9536(02)00073-4.CrossRefPubMed Oakes J, Rossi P: The measurement of SES in health research: current practice and steps toward a new approach. Soc Sci Med. 2003, 56 (4): 769-784. 10.1016/S0277-9536(02)00073-4.CrossRefPubMed
20.
go back to reference Berkman L: Role of Social-relations in health promotion. Psychosom Med. 1995, 57 (3): 245-254. 10.1097/00006842-199505000-00006.CrossRefPubMed Berkman L: Role of Social-relations in health promotion. Psychosom Med. 1995, 57 (3): 245-254. 10.1097/00006842-199505000-00006.CrossRefPubMed
21.
go back to reference Berkman L, Glass T, Brissette I, Seeman T: From social integration to health: Durkheim in the new millennium. Soc Sci Med. 2000, 51 (6): 843-857. 10.1016/S0277-9536(00)00065-4.CrossRefPubMed Berkman L, Glass T, Brissette I, Seeman T: From social integration to health: Durkheim in the new millennium. Soc Sci Med. 2000, 51 (6): 843-857. 10.1016/S0277-9536(00)00065-4.CrossRefPubMed
22.
go back to reference Diez Roux AV: Next steps in understanding the multilevel determinants of health. J Epidemiol Community Health. 2008, 62 (11): 957-959. 10.1136/jech.2007.064311.CrossRefPubMed Diez Roux AV: Next steps in understanding the multilevel determinants of health. J Epidemiol Community Health. 2008, 62 (11): 957-959. 10.1136/jech.2007.064311.CrossRefPubMed
23.
go back to reference Cubbin C, Winkleby MA: Protective and harmful effects of neighborhood-level deprivation on individual-level health knowledge, behavior changes, and risk of coronary heart disease. Am J Epidemiol. 2005, 162 (6): 559-568. 10.1093/aje/kwi250.CrossRefPubMed Cubbin C, Winkleby MA: Protective and harmful effects of neighborhood-level deprivation on individual-level health knowledge, behavior changes, and risk of coronary heart disease. Am J Epidemiol. 2005, 162 (6): 559-568. 10.1093/aje/kwi250.CrossRefPubMed
24.
go back to reference Winkleby M, Cubbin C, Ahn D: Effect of cross-level interaction between individual and neighborhood socioeconomic status on adult mortality rates. Am J Public Health. 2006, 96 (12): 2145-2153. 10.2105/AJPH.2004.060970.CrossRefPubMedPubMedCentral Winkleby M, Cubbin C, Ahn D: Effect of cross-level interaction between individual and neighborhood socioeconomic status on adult mortality rates. Am J Public Health. 2006, 96 (12): 2145-2153. 10.2105/AJPH.2004.060970.CrossRefPubMedPubMedCentral
25.
go back to reference Taylor CB, Ahn D, Winkleby MA: Neighborhood and individual socioeconomic determinants of hospitalization. Am J Prev Med. 2006, 31 (2): 127-134. 10.1016/j.amepre.2006.03.025.CrossRefPubMed Taylor CB, Ahn D, Winkleby MA: Neighborhood and individual socioeconomic determinants of hospitalization. Am J Prev Med. 2006, 31 (2): 127-134. 10.1016/j.amepre.2006.03.025.CrossRefPubMed
26.
go back to reference Claudio L, Tulton L, Doucette J, Landrigan PJ: Socioeconomic factors and asthma hospitalization rates in New York City. J Asthma. 1999, 36 (4): 343-350. 10.3109/02770909909068227.CrossRefPubMed Claudio L, Tulton L, Doucette J, Landrigan PJ: Socioeconomic factors and asthma hospitalization rates in New York City. J Asthma. 1999, 36 (4): 343-350. 10.3109/02770909909068227.CrossRefPubMed
28.
go back to reference Morrato EH, Druss B, Hartung DM, Valuck RJ, Allen R, Campagna E, Newcomer JW: Metabolic testing rates in 3 state Medicaid programs after FDA warnings and ADA/APA recommendations for second-generation antipsychotic drugs. Arch Gen Psychiatry. 2010, 67 (1): 17-24. 10.1001/archgenpsychiatry.2009.179.CrossRefPubMed Morrato EH, Druss B, Hartung DM, Valuck RJ, Allen R, Campagna E, Newcomer JW: Metabolic testing rates in 3 state Medicaid programs after FDA warnings and ADA/APA recommendations for second-generation antipsychotic drugs. Arch Gen Psychiatry. 2010, 67 (1): 17-24. 10.1001/archgenpsychiatry.2009.179.CrossRefPubMed
29.
go back to reference Morrato EH, Druss BG, Hartung DM, Valuck RJ, Thomas D, Allen R, Campagna E, Newcomer JW: Small area variation and geographic and patient-specific determinants of metabolic testing in antipsychotic users. Pharmacoepidemiol Drug Saf. 2011, 20 (1): 66-75. 10.1002/pds.2062.CrossRefPubMed Morrato EH, Druss BG, Hartung DM, Valuck RJ, Thomas D, Allen R, Campagna E, Newcomer JW: Small area variation and geographic and patient-specific determinants of metabolic testing in antipsychotic users. Pharmacoepidemiol Drug Saf. 2011, 20 (1): 66-75. 10.1002/pds.2062.CrossRefPubMed
30.
go back to reference Anselin L, Kim Y, Syabri I: Web-based analytical tools for the exploration of spatial data. J Geogr Syst. 2004, 6 (2): 197-218.CrossRef Anselin L, Kim Y, Syabri I: Web-based analytical tools for the exploration of spatial data. J Geogr Syst. 2004, 6 (2): 197-218.CrossRef
31.
go back to reference Anselin L: How (not) to lie with spatial statistics. Am J Prev Med. 2006, 30 (2): S3-S6. 10.1016/j.amepre.2005.09.015.CrossRefPubMed Anselin L: How (not) to lie with spatial statistics. Am J Prev Med. 2006, 30 (2): S3-S6. 10.1016/j.amepre.2005.09.015.CrossRefPubMed
32.
go back to reference Bailey TC, Gatrell AC: Interactive spatial data analysis. 1995, Harlow Essex, England; New York, NY: Longman Scientific & Technical; J. Wiley Bailey TC, Gatrell AC: Interactive spatial data analysis. 1995, Harlow Essex, England; New York, NY: Longman Scientific & Technical; J. Wiley
33.
go back to reference Anselin L, Florax RJGM, Rey SJ: Advances in spatial econometrics: methodology, tools and applications. 2004, Berlin: Springer-VerlagCrossRef Anselin L, Florax RJGM, Rey SJ: Advances in spatial econometrics: methodology, tools and applications. 2004, Berlin: Springer-VerlagCrossRef
34.
go back to reference Anselin L: Local Indicators of Spaital Association - LISA. Geogr Anal. 1995, 27 (2): 93-115.CrossRef Anselin L: Local Indicators of Spaital Association - LISA. Geogr Anal. 1995, 27 (2): 93-115.CrossRef
35.
go back to reference Gelman A, Hill J: Data Analysis Using Regression and Multilevel/Hierarchical Models. 2006, New York, NY: Cambridge University PressCrossRef Gelman A, Hill J: Data Analysis Using Regression and Multilevel/Hierarchical Models. 2006, New York, NY: Cambridge University PressCrossRef
36.
go back to reference Diez-Roux AV: Multilevel analysis in public health research. Annu Rev Public Health. 2000, 21: 171-192. 10.1146/annurev.publhealth.21.1.171.CrossRefPubMed Diez-Roux AV: Multilevel analysis in public health research. Annu Rev Public Health. 2000, 21: 171-192. 10.1146/annurev.publhealth.21.1.171.CrossRefPubMed
37.
go back to reference Leventhal T, Brooks-Gunn J: The neighborhoods they live in: The effects of neighborhood residence on child and adolescent outcomes. Psychol Bull. 2000, 126 (2): 309-337.CrossRefPubMed Leventhal T, Brooks-Gunn J: The neighborhoods they live in: The effects of neighborhood residence on child and adolescent outcomes. Psychol Bull. 2000, 126 (2): 309-337.CrossRefPubMed
38.
go back to reference Riva M, Gauvin L, Barnett TA: Toward the next generation of research into small area effects on health: a synthesis of multilevel investigations published since July 1998. J Epidemiol Community Health. 2007, 61 (10): 853-861. 10.1136/jech.2006.050740.CrossRefPubMedPubMedCentral Riva M, Gauvin L, Barnett TA: Toward the next generation of research into small area effects on health: a synthesis of multilevel investigations published since July 1998. J Epidemiol Community Health. 2007, 61 (10): 853-861. 10.1136/jech.2006.050740.CrossRefPubMedPubMedCentral
39.
go back to reference Chaix B, Rosvall M, Merlo J: Recent increase of neighborhood socioeconomic effects on ischemic heart disease mortality: A multilevel survival analysis of two large Swedish cohorts. Am J Epidemiol. 2007, 165 (1): 22-26.CrossRefPubMed Chaix B, Rosvall M, Merlo J: Recent increase of neighborhood socioeconomic effects on ischemic heart disease mortality: A multilevel survival analysis of two large Swedish cohorts. Am J Epidemiol. 2007, 165 (1): 22-26.CrossRefPubMed
Metadata
Title
Adjusting for geographic variation in observational comparative effectiveness studies: a case study of antipsychotics using state Medicaid data
Authors
Elisabeth Dowling Root
Deborah SK Thomas
Elizabeth J Campagna
Elaine H Morrato
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-14-355

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue