Skip to main content
Top
Published in: Implementation Science 1/2007

Open Access 01-12-2007 | Research article

Using a summary measure for multiple quality indicators in primary care: the Summary QUality InDex (SQUID)

Authors: Paul J Nietert, Andrea M Wessell, Ruth G Jenkins, Chris Feifer, Lynne S Nemeth, Steven M Ornstein

Published in: Implementation Science | Issue 1/2007

Login to get access

Abstract

Background

Assessing the quality of primary care is becoming a priority in national healthcare agendas. Audit and feedback on healthcare quality performance indicators can help improve the quality of care provided. In some instances, fewer numbers of more comprehensive indicators may be preferable. This paper describes the use of the Summary Quality Index (SQUID) in tracking quality of care among patients and primary care practices that use an electronic medical record (EMR). All practices are part of the Practice Partner Research Network, representing over 100 ambulatory care practices throughout the United States.

Methods

The SQUID is comprised of 36 process and outcome measures, all of which are obtained from the EMR. This paper describes algorithms for the SQUID calculations, various statistical properties, and use of the SQUID within the context of a multi-practice quality improvement (QI) project.

Results

At any given time point, the patient-level SQUID reflects the proportion of recommended care received, while the practice-level SQUID reflects the average proportion of recommended care received by that practice's patients. Using quarterly reports, practice- and patient-level SQUIDs are provided routinely to practices within the network. The SQUID is responsive, exhibiting highly significant (p < 0.0001) increases during a major QI initiative, and its internal consistency is excellent (Cronbach's alpha = 0.93). Feedback from physicians has been extremely positive, providing a high degree of face validity.

Conclusion

The SQUID algorithm is feasible and straightforward, and provides a useful QI tool. Its statistical properties and clear interpretation make it appealing to providers, health plans, and researchers.
Appendix
Available only for authorised users
Literature
2.
go back to reference Grimshaw J, McAuley LM, Bero LA, Grilli R, Oxman AD, Ramsay C, Vale L, Zwarenstein M: Systematic reviews of the effectiveness of quality improvement strategies and programmes. Qual Saf Health Care. 2003, 12: 298-303. 10.1136/qhc.12.4.298.CrossRefPubMedPubMedCentral Grimshaw J, McAuley LM, Bero LA, Grilli R, Oxman AD, Ramsay C, Vale L, Zwarenstein M: Systematic reviews of the effectiveness of quality improvement strategies and programmes. Qual Saf Health Care. 2003, 12: 298-303. 10.1136/qhc.12.4.298.CrossRefPubMedPubMedCentral
3.
go back to reference Davis DA, Thomson MA, Oxman AD, Haynes RB: Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995, 274: 700-705. 10.1001/jama.274.9.700.CrossRefPubMed Davis DA, Thomson MA, Oxman AD, Haynes RB: Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995, 274: 700-705. 10.1001/jama.274.9.700.CrossRefPubMed
4.
go back to reference Zaslavsky AM, Shaul JA, Zaborski LB, Cioffi MJ, Cleary PD: Combining health plan performance indicators into simpler composite measures. Health Care Financ Rev. 2002, 23: 101-115.PubMedPubMedCentral Zaslavsky AM, Shaul JA, Zaborski LB, Cioffi MJ, Cleary PD: Combining health plan performance indicators into simpler composite measures. Health Care Financ Rev. 2002, 23: 101-115.PubMedPubMedCentral
6.
go back to reference Kerr EA, McGlynn EA, Adams J, Keesey J, Asch SM: Profiling the quality of care in twelve communities: results from the CQI study. Health Aff. 2004, 23: 247-256. 10.1377/hlthaff.23.3.247.CrossRef Kerr EA, McGlynn EA, Adams J, Keesey J, Asch SM: Profiling the quality of care in twelve communities: results from the CQI study. Health Aff. 2004, 23: 247-256. 10.1377/hlthaff.23.3.247.CrossRef
7.
go back to reference McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. New Engl J Med. 2003, 348: 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. New Engl J Med. 2003, 348: 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed
8.
go back to reference Perlin JB, Kolodner RM, Roswell RH: The Veterans Health Administration: quality, value, accountability, and information as transforming strategies for patient-centered care. Healthc Pap. 2005, 5: 10-24.CrossRefPubMed Perlin JB, Kolodner RM, Roswell RH: The Veterans Health Administration: quality, value, accountability, and information as transforming strategies for patient-centered care. Healthc Pap. 2005, 5: 10-24.CrossRefPubMed
9.
go back to reference Landrum MB, Bronskill SE, Normand ST: Analytic methods for constructing cross-sectional profiles of health care providers. Health Serv Outcomes Res Methodol. 2000, 1: 23-47. 10.1023/A:1010093701870.CrossRef Landrum MB, Bronskill SE, Normand ST: Analytic methods for constructing cross-sectional profiles of health care providers. Health Serv Outcomes Res Methodol. 2000, 1: 23-47. 10.1023/A:1010093701870.CrossRef
10.
go back to reference Normand ST, Glickman ME, Gastonis CA: Statistical methods for profiling providers of medical care: issues and applications. J Am Stat Assn. 1997, 92: 803-814. 10.2307/2965545.CrossRef Normand ST, Glickman ME, Gastonis CA: Statistical methods for profiling providers of medical care: issues and applications. J Am Stat Assn. 1997, 92: 803-814. 10.2307/2965545.CrossRef
11.
go back to reference O'Brien PC: Procedures for comparing samples with multiple endpoints. Biometrics. 1984, 40: 1079-1087. 10.2307/2531158.CrossRefPubMed O'Brien PC: Procedures for comparing samples with multiple endpoints. Biometrics. 1984, 40: 1079-1087. 10.2307/2531158.CrossRefPubMed
12.
go back to reference Tilley BC, Pillemer SR, Heyse SP, Li S, Clegg DO, Alarcon GS: Global statistical tests for comparing multiple outcomes in rheumatoid arthritis trials. MIRA Trial Group. Arthritis Rheum. 1999, 42: 1879-1888. 10.1002/1529-0131(199909)42:9<1879::AID-ANR12>3.0.CO;2-1.CrossRefPubMed Tilley BC, Pillemer SR, Heyse SP, Li S, Clegg DO, Alarcon GS: Global statistical tests for comparing multiple outcomes in rheumatoid arthritis trials. MIRA Trial Group. Arthritis Rheum. 1999, 42: 1879-1888. 10.1002/1529-0131(199909)42:9<1879::AID-ANR12>3.0.CO;2-1.CrossRefPubMed
13.
go back to reference Pocock SJ, Geller NL, Tsiatis AA: The analysis of multiple endpoints in clinical trials. Biometrics. 1987, 43: 487-498. 10.2307/2531989.CrossRefPubMed Pocock SJ, Geller NL, Tsiatis AA: The analysis of multiple endpoints in clinical trials. Biometrics. 1987, 43: 487-498. 10.2307/2531989.CrossRefPubMed
14.
go back to reference Lefkopoulou M, Ryan L: Global tests for multiple binary outcomes. Biometrics. 1993, 49: 975-988. 10.2307/2532240.CrossRefPubMed Lefkopoulou M, Ryan L: Global tests for multiple binary outcomes. Biometrics. 1993, 49: 975-988. 10.2307/2532240.CrossRefPubMed
16.
go back to reference Guidelines for the evaluation and management of heart failure. Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee on Evaluation and Management of Heart Failure). Circulation. 1995, 92: 2764-2784. Guidelines for the evaluation and management of heart failure. Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee on Evaluation and Management of Heart Failure). Circulation. 1995, 92: 2764-2784.
17.
go back to reference Centers for Disease Control and Prevention: Prevention of pneumococcal disease: recommendations of the Advisory Committee on Immunization Practices. Mor Mortal Wkly Rep CDC Surveill Summ. 1997, 46: 1-24. Centers for Disease Control and Prevention: Prevention of pneumococcal disease: recommendations of the Advisory Committee on Immunization Practices. Mor Mortal Wkly Rep CDC Surveill Summ. 1997, 46: 1-24.
18.
go back to reference Chobanian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, Jones DW, Materson BJ, Oparil S, Wright JT, Roccella EJ: The Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure: the JNC 7 report. JAMA. 2003, 289: 2560-2572. 10.1001/jama.289.19.2560.CrossRefPubMed Chobanian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, Jones DW, Materson BJ, Oparil S, Wright JT, Roccella EJ: The Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure: the JNC 7 report. JAMA. 2003, 289: 2560-2572. 10.1001/jama.289.19.2560.CrossRefPubMed
19.
go back to reference Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) final report. Circulation. 2002, 106: 3143-3421. Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) final report. Circulation. 2002, 106: 3143-3421.
20.
go back to reference Smith SC, Blair SN, Criqui MH, Fletcher GF, Fuster V, Gersh BJ, Gotto AM, Gould KL, Greenland P, Grundy SM, .: Preventing heart attack and death in patients with coronary disease. Circulation. 1995, 92: 2-4.CrossRefPubMed Smith SC, Blair SN, Criqui MH, Fletcher GF, Fuster V, Gersh BJ, Gotto AM, Gould KL, Greenland P, Grundy SM, .: Preventing heart attack and death in patients with coronary disease. Circulation. 1995, 92: 2-4.CrossRefPubMed
21.
go back to reference Prystowsky EN, Benson DW, Fuster V, Hart RG, Kay GN, Myerburg RJ, Naccarelli GV, Wyse DG: Management of patients with atrial fibrillation. A Statement for Healthcare Professionals. From the Subcommittee on Electrocardiography and Electrophysiology, American Heart Association. Circulation. 1996, 93: 1262-1277.CrossRefPubMed Prystowsky EN, Benson DW, Fuster V, Hart RG, Kay GN, Myerburg RJ, Naccarelli GV, Wyse DG: Management of patients with atrial fibrillation. A Statement for Healthcare Professionals. From the Subcommittee on Electrocardiography and Electrophysiology, American Heart Association. Circulation. 1996, 93: 1262-1277.CrossRefPubMed
23.
go back to reference Smith RA, Saslow D, Sawyer KA, Burke W, Costanza ME, Evans WP, Foster RS, Hendrick E, Eyre HJ, Sener S: American Cancer Society guidelines for breast cancer screening: update 2003. CA Cancer J Clin. 2003, 53: 141-169.CrossRefPubMed Smith RA, Saslow D, Sawyer KA, Burke W, Costanza ME, Evans WP, Foster RS, Hendrick E, Eyre HJ, Sener S: American Cancer Society guidelines for breast cancer screening: update 2003. CA Cancer J Clin. 2003, 53: 141-169.CrossRefPubMed
25.
go back to reference Pearson TA, Blair SN, Daniels SR, Eckel RH, Fair JM, Fortmann SP, Franklin BA, Goldstein LB, Greenland P, Grundy SM, Hong Y, Miller NH, Lauer RM, Ockene IS, Sacco RL, Sallis JF, Smith SC, Stone NJ, Taubert KA: AHA Guidelines for Primary Prevention of Cardiovascular Disease and Stroke: 2002 Update: Consensus Panel Guide to Comprehensive Risk Reduction for Adult Patients Without Coronary or Other Atherosclerotic Vascular Diseases. American Heart Association Science Advisory and Coordinating Committee. Circulation. 2002, 106: 388-391. 10.1161/01.CIR.0000020190.45892.75.CrossRefPubMed Pearson TA, Blair SN, Daniels SR, Eckel RH, Fair JM, Fortmann SP, Franklin BA, Goldstein LB, Greenland P, Grundy SM, Hong Y, Miller NH, Lauer RM, Ockene IS, Sacco RL, Sallis JF, Smith SC, Stone NJ, Taubert KA: AHA Guidelines for Primary Prevention of Cardiovascular Disease and Stroke: 2002 Update: Consensus Panel Guide to Comprehensive Risk Reduction for Adult Patients Without Coronary or Other Atherosclerotic Vascular Diseases. American Heart Association Science Advisory and Coordinating Committee. Circulation. 2002, 106: 388-391. 10.1161/01.CIR.0000020190.45892.75.CrossRefPubMed
28.
go back to reference Beers MH: Explicit criteria for determining potentially inappropriate medication use by the elderly. An update. Arch Intern Med. 1997, 157: 1531-1536. 10.1001/archinte.157.14.1531.CrossRefPubMed Beers MH: Explicit criteria for determining potentially inappropriate medication use by the elderly. An update. Arch Intern Med. 1997, 157: 1531-1536. 10.1001/archinte.157.14.1531.CrossRefPubMed
29.
go back to reference Feifer C, Ornstein SM, Jenkins RG, Wessell A, Corley ST, Nemeth LS, Roylance L, Nietert PJ, Liszka H: The logic behind a multimethod intervention to improve adherence to clinical practice guidelines in a nationwide network of primary care practices. Eval Health Prof. 2006, 29: 65-88. 10.1177/0163278705284443.CrossRefPubMed Feifer C, Ornstein SM, Jenkins RG, Wessell A, Corley ST, Nemeth LS, Roylance L, Nietert PJ, Liszka H: The logic behind a multimethod intervention to improve adherence to clinical practice guidelines in a nationwide network of primary care practices. Eval Health Prof. 2006, 29: 65-88. 10.1177/0163278705284443.CrossRefPubMed
30.
go back to reference Ornstein SM, Nietert PJ, Jenkins RG, Wessell AM, Nemeth LS, C. F, Corley ST: Improving diabetes care through a multi-component quality improvement model in a practice-based research network. Am J Med Qual. 2007, 22: 34-41. 10.1177/1062860606295206.CrossRefPubMed Ornstein SM, Nietert PJ, Jenkins RG, Wessell AM, Nemeth LS, C. F, Corley ST: Improving diabetes care through a multi-component quality improvement model in a practice-based research network. Am J Med Qual. 2007, 22: 34-41. 10.1177/1062860606295206.CrossRefPubMed
31.
32.
go back to reference McGlynn EA, Asch SM: Developing a clinical performance measure. Am J Prev Med. 1998, 14: 14-21. 10.1016/S0749-3797(97)00032-9.CrossRefPubMed McGlynn EA, Asch SM: Developing a clinical performance measure. Am J Prev Med. 1998, 14: 14-21. 10.1016/S0749-3797(97)00032-9.CrossRefPubMed
33.
go back to reference Eddy DM: Performance measurement: problems and solutions. Health Aff. 1998, 17: 7-25. 10.1377/hlthaff.17.4.7.CrossRef Eddy DM: Performance measurement: problems and solutions. Health Aff. 1998, 17: 7-25. 10.1377/hlthaff.17.4.7.CrossRef
34.
go back to reference Brook RH, McGlynn EA, Shekelle PG: Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care. 2000, 12: 281-295. 10.1093/intqhc/12.4.281.CrossRefPubMed Brook RH, McGlynn EA, Shekelle PG: Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care. 2000, 12: 281-295. 10.1093/intqhc/12.4.281.CrossRefPubMed
35.
go back to reference Kahn KL, Tisnado DM, Adams JL, Liu H, Chen W, Hu FA, Mangione CM, Hays RD, Damberg CL: Does ambulatory process of care predict health-related quality of life outcomes for patients with chronic disease?. Health Serv Res. 2007, 42: 63-83. 10.1111/j.1475-6773.2006.00604.x.CrossRefPubMedPubMedCentral Kahn KL, Tisnado DM, Adams JL, Liu H, Chen W, Hu FA, Mangione CM, Hays RD, Damberg CL: Does ambulatory process of care predict health-related quality of life outcomes for patients with chronic disease?. Health Serv Res. 2007, 42: 63-83. 10.1111/j.1475-6773.2006.00604.x.CrossRefPubMedPubMedCentral
36.
go back to reference Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2: i-iv, 1-74. Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2: i-iv, 1-74.
38.
go back to reference Ornstein SM, Jenkins RG, Nietert PJ, Feifer C, Roylance LF, L. N, S. C, Dickerson LM, Bradford WD, C. L: Multi-method quality improvement intervention vs. quarterly performance reports to improve preventive cardiovascular care: a cluster randomized trial. Ann Intern Med. 2004, 141: 523-532.CrossRefPubMed Ornstein SM, Jenkins RG, Nietert PJ, Feifer C, Roylance LF, L. N, S. C, Dickerson LM, Bradford WD, C. L: Multi-method quality improvement intervention vs. quarterly performance reports to improve preventive cardiovascular care: a cluster randomized trial. Ann Intern Med. 2004, 141: 523-532.CrossRefPubMed
39.
go back to reference Parker DR, Evangelou E, Eaton CB: Intraclass correlation coefficients for cluster randomized trials in primary care: the cholesterol education and research trial (CEART). Contemp Clin Trials. 2005, 26: 260-267. 10.1016/j.cct.2005.01.002.CrossRefPubMed Parker DR, Evangelou E, Eaton CB: Intraclass correlation coefficients for cluster randomized trials in primary care: the cholesterol education and research trial (CEART). Contemp Clin Trials. 2005, 26: 260-267. 10.1016/j.cct.2005.01.002.CrossRefPubMed
40.
go back to reference Hays RD, Morales LS, Reise SP: Item response theory and health outcomes measurement in the 21st century. Med Care. 2000, 38: II28-II42. 10.1097/00005650-200009002-00007.CrossRefPubMedPubMedCentral Hays RD, Morales LS, Reise SP: Item response theory and health outcomes measurement in the 21st century. Med Care. 2000, 38: II28-II42. 10.1097/00005650-200009002-00007.CrossRefPubMedPubMedCentral
Metadata
Title
Using a summary measure for multiple quality indicators in primary care: the Summary QUality InDex (SQUID)
Authors
Paul J Nietert
Andrea M Wessell
Ruth G Jenkins
Chris Feifer
Lynne S Nemeth
Steven M Ornstein
Publication date
01-12-2007
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2007
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-2-11

Other articles of this Issue 1/2007

Implementation Science 1/2007 Go to the issue