Skip to main content
Top
Published in: BMC Health Services Research 1/2008

Open Access 01-12-2008 | Research article

How to limit the burden of data collection for Quality Indicators based on medical records? The COMPAQH experience

Authors: Clément Corriol, Valentin Daucourt, Catherine Grenier, Etienne Minvielle

Published in: BMC Health Services Research | Issue 1/2008

Login to get access

Abstract

Background

Our objective was to limit the burden of data collection for Quality Indicators (QIs) based on medical records.

Methods

The study was supervised by the COMPAQH project. Four QIs based on medical records were tested: medical record conformity; traceability of pain assessment; screening for nutritional disorders; time elapsed before sending copy of discharge letter to the general practitioner. Data were collected by 6 Clinical Research Assistants (CRAs) in a panel of 36 volunteer hospitals and analyzed by COMPAQH. To limit the burden of data collection, we used the same sample of medical records for all 4 QIs, limited sample size to 80 medical records, and built a composite score of only 10 items to assess medical record completeness. We assessed QI feasibility by completing a grid of 19 potential problems and evaluating time spent. We assessed reliability (κ coefficient) as well as internal consistency (Cronbach α coefficient) in an inter-observer study, and discriminatory power by analysing QI variability among hospitals.

Results

Overall, 23 115 data items were collected for the 4 QIs and analyzed. The average time spent on data collection was 8.5 days per hospital. The most common feasibility problem was misunderstanding of the item by hospital staff. QI reliability was good (κ: 0.59–0.97 according to QI). The hospitals differed widely in their ability to meet the quality criteria (mean value: 19–85%).

Conclusion

These 4 QIs based on medical records can be used to compare the quality of record keeping among hospitals while limiting the burden of data collection, and can therefore be used for benchmarking purposes. The French National Health Directorate has included them in the new 2009 version of the accreditation procedure for healthcare organizations.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wood DL: Documentation guidelines: evolution, future direction, and compliance. Am J Med. 2001, 110: 332-334. 10.1016/S0002-9343(00)00748-8.CrossRefPubMed Wood DL: Documentation guidelines: evolution, future direction, and compliance. Am J Med. 2001, 110: 332-334. 10.1016/S0002-9343(00)00748-8.CrossRefPubMed
2.
go back to reference Daucourt V, Michel P: Results of the first 100 accreditation procedures in France. Int J Qual Health Care. 2003, 15: 463-471. 10.1093/intqhc/mzg071.CrossRefPubMed Daucourt V, Michel P: Results of the first 100 accreditation procedures in France. Int J Qual Health Care. 2003, 15: 463-471. 10.1093/intqhc/mzg071.CrossRefPubMed
4.
go back to reference Schneider KM, Wiblin RT, Downs KS, O'Donnell BE: Methods for evaluating the provision of well child care. Jt Comm J Qual Improv. 2001, 27: 673-682.PubMed Schneider KM, Wiblin RT, Downs KS, O'Donnell BE: Methods for evaluating the provision of well child care. Jt Comm J Qual Improv. 2001, 27: 673-682.PubMed
5.
go back to reference Keating NL, Landrum MB, Landon BE, Ayanian JZ, Borbas C, Guadagnoli E: Measuring the quality of diabetes care using administrative data: is there bias?. Health Serv Res. 2003, 38: 1529-1545. 10.1111/j.1475-6773.2003.00191.x.CrossRefPubMedPubMedCentral Keating NL, Landrum MB, Landon BE, Ayanian JZ, Borbas C, Guadagnoli E: Measuring the quality of diabetes care using administrative data: is there bias?. Health Serv Res. 2003, 38: 1529-1545. 10.1111/j.1475-6773.2003.00191.x.CrossRefPubMedPubMedCentral
6.
go back to reference Gilbert EH, Lowenstein SR, Koziol-McLain J, Barta DC, Steiner J: Chart reviews in emergency medicine research: where are the methods?. Ann Emerg Med. 1996, 27: 305-308. 10.1016/S0196-0644(96)70264-0.CrossRefPubMed Gilbert EH, Lowenstein SR, Koziol-McLain J, Barta DC, Steiner J: Chart reviews in emergency medicine research: where are the methods?. Ann Emerg Med. 1996, 27: 305-308. 10.1016/S0196-0644(96)70264-0.CrossRefPubMed
7.
go back to reference Luck J, Peabody JW, Dresselhaus TR, Lee M, Glassman P: How well does chart abstraction measure quality? A prospective comparison of quality between standardized patients and the medical record. Am J Med. 2000, 108: 642-649. 10.1016/S0002-9343(00)00363-6.CrossRefPubMed Luck J, Peabody JW, Dresselhaus TR, Lee M, Glassman P: How well does chart abstraction measure quality? A prospective comparison of quality between standardized patients and the medical record. Am J Med. 2000, 108: 642-649. 10.1016/S0002-9343(00)00363-6.CrossRefPubMed
8.
go back to reference Dresselhaus TR, Peabody JW, Lee M, Wang MM, Luck J: Measuring Compliance with preventive care guidelines:standardized patients, clinical vignettes and the medical record. J Gen Intern Med. 2000, 15: 782-788. 10.1046/j.1525-1497.2000.91007.x.CrossRefPubMedPubMedCentral Dresselhaus TR, Peabody JW, Lee M, Wang MM, Luck J: Measuring Compliance with preventive care guidelines:standardized patients, clinical vignettes and the medical record. J Gen Intern Med. 2000, 15: 782-788. 10.1046/j.1525-1497.2000.91007.x.CrossRefPubMedPubMedCentral
9.
go back to reference Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M: Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000, 283: 1715-1722. 10.1001/jama.283.13.1715.CrossRefPubMed Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M: Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000, 283: 1715-1722. 10.1001/jama.283.13.1715.CrossRefPubMed
10.
go back to reference Weiner M, Stump TE, Callahan CM, Lewis JN, McDonald CJ: Pursuing integration of performance measures into receptor electronic medical records: beta-adrenergic antagonist medications. Qual Saf Health Care. 2005, 14: 99-106. 10.1136/qshc.2004.011049.CrossRefPubMedPubMedCentral Weiner M, Stump TE, Callahan CM, Lewis JN, McDonald CJ: Pursuing integration of performance measures into receptor electronic medical records: beta-adrenergic antagonist medications. Qual Saf Health Care. 2005, 14: 99-106. 10.1136/qshc.2004.011049.CrossRefPubMedPubMedCentral
11.
go back to reference Grenier-Sennelier C, Corriol C, Daucourt V, Aronica E, Michel P, Minvielle E: Developing quality indicators in hospitals: the COMPAQH project. Rev Epidemiol Sante Publique. 2005, 53 (Spec No 1): 1S22-30.PubMed Grenier-Sennelier C, Corriol C, Daucourt V, Aronica E, Michel P, Minvielle E: Developing quality indicators in hospitals: the COMPAQH project. Rev Epidemiol Sante Publique. 2005, 53 (Spec No 1): 1S22-30.PubMed
12.
go back to reference McGlynn EA, Kerr EA, Adams J, Keesey J, Asch SM: Quality of health care for women: a demonstration of the quality assessment tools system. Med Care. 2003, 41: 616-625. 10.1097/00005650-200305000-00009.PubMed McGlynn EA, Kerr EA, Adams J, Keesey J, Asch SM: Quality of health care for women: a demonstration of the quality assessment tools system. Med Care. 2003, 41: 616-625. 10.1097/00005650-200305000-00009.PubMed
13.
go back to reference Arkin CF, Wachtel MS: How many patients are necessary to assess test performance?. JAMA. 1990, 12 (2): 275-278. 10.1001/jama.263.2.275.CrossRef Arkin CF, Wachtel MS: How many patients are necessary to assess test performance?. JAMA. 1990, 12 (2): 275-278. 10.1001/jama.263.2.275.CrossRef
14.
go back to reference Streiner D, Norman G: Health Measurement Scales. A Practical Guide to their Development and Use. 1995, Oxford University Press, 2 Streiner D, Norman G: Health Measurement Scales. A Practical Guide to their Development and Use. 1995, Oxford University Press, 2
15.
go back to reference Nunnally JC: Psychometric Theory. 1978, New York: McGraw-Hill, 2 Nunnally JC: Psychometric Theory. 1978, New York: McGraw-Hill, 2
17.
go back to reference Bird SM, Cox D, Farewell VT, Goldstein H, Holt T, Smith PC: Performance indicators: good, bad, and ugly. J R Statistical Soc. 2005, 168: 1-27. 10.1111/j.1467-985X.2004.00333.x.CrossRef Bird SM, Cox D, Farewell VT, Goldstein H, Holt T, Smith PC: Performance indicators: good, bad, and ugly. J R Statistical Soc. 2005, 168: 1-27. 10.1111/j.1467-985X.2004.00333.x.CrossRef
18.
go back to reference Morris L, Taylor M, Campbell LM, Sullivan FM: How will practices cope with information for the new GMS contract? Coronary heart disease data recording in five Scottish practices. Inform Prim Care. 2003, 11: 121-127.PubMed Morris L, Taylor M, Campbell LM, Sullivan FM: How will practices cope with information for the new GMS contract? Coronary heart disease data recording in five Scottish practices. Inform Prim Care. 2003, 11: 121-127.PubMed
19.
go back to reference Fairbrother G, Hanson KL, Friedman S, Butts GC: The impact of physician bonuses, enhanced fees, and feed-back on childhood immunization coverage rates. Am J Public Health. 1999, 89: 171-175. 10.2105/AJPH.89.2.171.CrossRefPubMedPubMedCentral Fairbrother G, Hanson KL, Friedman S, Butts GC: The impact of physician bonuses, enhanced fees, and feed-back on childhood immunization coverage rates. Am J Public Health. 1999, 89: 171-175. 10.2105/AJPH.89.2.171.CrossRefPubMedPubMedCentral
20.
go back to reference Lofgren JP, Brown HR, Lesinger C, Sims W: Increase in Alabama public health immunization levels coinciding with monthly distribution of county immunization levels comparisons and financial rewards for accomplishments. Conference abstracts from the 31st National Immunization Conference; May 19–22. 1997, ; Detroit, Mich Lofgren JP, Brown HR, Lesinger C, Sims W: Increase in Alabama public health immunization levels coinciding with monthly distribution of county immunization levels comparisons and financial rewards for accomplishments. Conference abstracts from the 31st National Immunization Conference; May 19–22. 1997, ; Detroit, Mich
21.
go back to reference Solomon DH, Schaffer JL, Katz JN, Horsky J, Burdick E, Nadler E, Bates DW: Can history and physical examination be used as markers of quality? An analysis of the initial visit note in musculoskeletal care. Med Care. 2000, 38: 383-391. 10.1097/00005650-200004000-00005.CrossRefPubMed Solomon DH, Schaffer JL, Katz JN, Horsky J, Burdick E, Nadler E, Bates DW: Can history and physical examination be used as markers of quality? An analysis of the initial visit note in musculoskeletal care. Med Care. 2000, 38: 383-391. 10.1097/00005650-200004000-00005.CrossRefPubMed
Metadata
Title
How to limit the burden of data collection for Quality Indicators based on medical records? The COMPAQH experience
Authors
Clément Corriol
Valentin Daucourt
Catherine Grenier
Etienne Minvielle
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2008
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-8-215

Other articles of this Issue 1/2008

BMC Health Services Research 1/2008 Go to the issue