Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis

Authors: Daniel Pinto, M Clare Robertson, Paul Hansen, J Haxby Abbott

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

Estimating costs is essential to the economic analysis of health care programs. Health care costs are often captured from administrative databases or by patient report. Administrative records only provide a partial representation of health care costs and have additional limitations. Patient-completed questionnaires may allow a broader representation of health care costs; however the validity and feasibility of such methods have not been firmly established. This study was conducted to assess the validity and feasibility of using a patient-completed questionnaire to capture health care use and costs for patients with osteoarthritis, and to compare the research costs of the data-capture methods.

Methods

We designed a patient questionnaire and applied it in a clinical trial. We captured equivalent data from four administrative databases. We evaluated aspects of the questionnaire's validity using sensitivity and specificity, Lin's concordance correlation coefficient (ρ c), and Bland-Altman comparisons.

Results

The questionnaire's response rate was 89%. Acceptable sensitivity and specificity levels were found for all types of health care use. The numbers of visits and the majority of medications reported by patients were in agreement with the database-derived estimates (ρ c > 0.40). Total cost estimates from the questionnaire agreed with those from the databases. Patient-reported co-payments agreed with administrative records with respect to GP office transactions, but not pharmaceutical co-payments. Research costs for the questionnaire-based method were less than one-third of the costs for the databases method.

Conclusion

A patient-completed questionnaire is feasible for capturing health care use and costs for patients with osteoarthritis, and data collected using it mostly agree with administrative databases. Caution should be exercised when applying unit costs and collecting co-payment data.
Appendix
Available only for authorised users
Literature
1.
go back to reference Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL: Methods for the economics evaluation of health care programmes. 2005, New York: Oxford University Press, 3 Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL: Methods for the economics evaluation of health care programmes. 2005, New York: Oxford University Press, 3
2.
go back to reference van den Brink M, van den Hout WB, Stiggelbout AM, van de Velde CJ, Kievit J: Cost measurement in economic evaluations of health care: whom to ask?. Med Care. 2004, 42 (8): 740-746. 10.1097/01.mlr.0000132351.78009.a1.CrossRefPubMed van den Brink M, van den Hout WB, Stiggelbout AM, van de Velde CJ, Kievit J: Cost measurement in economic evaluations of health care: whom to ask?. Med Care. 2004, 42 (8): 740-746. 10.1097/01.mlr.0000132351.78009.a1.CrossRefPubMed
3.
go back to reference Raina P, Torrance-Rynard V, Wong M, Woodward C: Agreement between self-reported and routinely collected health-care utilization data among seniors. Health Serv Res. 2002, 37 (7): 751-774. 10.1111/1475-6773.00047.CrossRefPubMedPubMedCentral Raina P, Torrance-Rynard V, Wong M, Woodward C: Agreement between self-reported and routinely collected health-care utilization data among seniors. Health Serv Res. 2002, 37 (7): 751-774. 10.1111/1475-6773.00047.CrossRefPubMedPubMedCentral
4.
go back to reference Ritter PL, Stewart AL, Kaymaz H, Sobel DS, Block DA, Lorig KR: Self-reports of health care utilization compared to provider records. J Clin Epidemiol. 2001, 54: 136-141. 10.1016/S0895-4356(00)00261-4.CrossRefPubMed Ritter PL, Stewart AL, Kaymaz H, Sobel DS, Block DA, Lorig KR: Self-reports of health care utilization compared to provider records. J Clin Epidemiol. 2001, 54: 136-141. 10.1016/S0895-4356(00)00261-4.CrossRefPubMed
5.
go back to reference van den Brink M, van den Hout WB, Stiggelbout AM, Putter H, van de Velde CJ, Kievit J: Self-reports of health-care utilization: diary or questionnaire?. Int J Technol Assess Health Care. 2005, 21 (3): 298-304. 10.1017/S0266462305050397.CrossRefPubMed van den Brink M, van den Hout WB, Stiggelbout AM, Putter H, van de Velde CJ, Kievit J: Self-reports of health-care utilization: diary or questionnaire?. Int J Technol Assess Health Care. 2005, 21 (3): 298-304. 10.1017/S0266462305050397.CrossRefPubMed
6.
go back to reference Jordan K, Jinks C, Croft P: Health care utilization: measurement using primary care records and patient recall both showed bias. J Clin Epidemiol. 2006, 59 (8): 791-797. 10.1016/j.jclinepi.2005.12.008.CrossRefPubMed Jordan K, Jinks C, Croft P: Health care utilization: measurement using primary care records and patient recall both showed bias. J Clin Epidemiol. 2006, 59 (8): 791-797. 10.1016/j.jclinepi.2005.12.008.CrossRefPubMed
7.
go back to reference Orrico KB: Sources and types of discrepancies between electronic medical records and actual outpatient medication use. J Managed Care Pharm. 2008, 14 (7): 626-631.CrossRef Orrico KB: Sources and types of discrepancies between electronic medical records and actual outpatient medication use. J Managed Care Pharm. 2008, 14 (7): 626-631.CrossRef
8.
go back to reference Patel A, Rendu A, Moran P, Leese M, Mann A, Knapp M: A comparison of two methods of collecting economic data in primary care. Fam Pract. 2005, 22 (3): 323-327. 10.1093/fampra/cmi027.CrossRefPubMed Patel A, Rendu A, Moran P, Leese M, Mann A, Knapp M: A comparison of two methods of collecting economic data in primary care. Fam Pract. 2005, 22 (3): 323-327. 10.1093/fampra/cmi027.CrossRefPubMed
9.
go back to reference Gold MR, Siegel JE, Russell LB, Weinstein MC, (eds.): Cost-effectiveness in health and medicine. 1996, New York: Oxford University Press Gold MR, Siegel JE, Russell LB, Weinstein MC, (eds.): Cost-effectiveness in health and medicine. 1996, New York: Oxford University Press
10.
go back to reference Goossens ME, Rutten-van Molken MP, Vlaeyen JW, van der Linden SM: The cost diary: a method to measure direct and indirect costs in cost-effectiveness research. J Clin Epidemiol. 2000, 53 (7): 688-695. 10.1016/S0895-4356(99)00177-8.CrossRefPubMed Goossens ME, Rutten-van Molken MP, Vlaeyen JW, van der Linden SM: The cost diary: a method to measure direct and indirect costs in cost-effectiveness research. J Clin Epidemiol. 2000, 53 (7): 688-695. 10.1016/S0895-4356(99)00177-8.CrossRefPubMed
11.
12.
go back to reference Richardson A: The health diary: an examination of its use as a data collection method. J Adv Nurs. 1994, 19 (4): 782-791. 10.1111/j.1365-2648.1994.tb01151.x.CrossRefPubMed Richardson A: The health diary: an examination of its use as a data collection method. J Adv Nurs. 1994, 19 (4): 782-791. 10.1111/j.1365-2648.1994.tb01151.x.CrossRefPubMed
13.
go back to reference Bhandari A, Wagner T: Self-reported utilization of health care services: improving measurement and accuracy. Med Care Res Rev. 2006, 63 (2): 217-235. 10.1177/1077558705285298.CrossRefPubMed Bhandari A, Wagner T: Self-reported utilization of health care services: improving measurement and accuracy. Med Care Res Rev. 2006, 63 (2): 217-235. 10.1177/1077558705285298.CrossRefPubMed
14.
go back to reference Cronan TA, Walen HR: Accuracy of self-reported healthcare use in patients with osteoarthritis. J Rheumatol. 2002, 29 (10): 2181-2184.PubMed Cronan TA, Walen HR: Accuracy of self-reported healthcare use in patients with osteoarthritis. J Rheumatol. 2002, 29 (10): 2181-2184.PubMed
15.
go back to reference King A: The primary health care strategy. 2001, Wellington: Ministry of health King A: The primary health care strategy. 2001, Wellington: Ministry of health
16.
go back to reference Health expenditure trends in New Zealand 1990-2001. 2002, Wellington: Ministry of Health Health expenditure trends in New Zealand 1990-2001. 2002, Wellington: Ministry of Health
17.
go back to reference Hefford M, Crampton P, Foley J: Reducing health disparities through primary care reform: the New Zealand experiment. Health Policy. 2005, 72: 9-23. 10.1016/j.healthpol.2004.06.005.CrossRefPubMed Hefford M, Crampton P, Foley J: Reducing health disparities through primary care reform: the New Zealand experiment. Health Policy. 2005, 72: 9-23. 10.1016/j.healthpol.2004.06.005.CrossRefPubMed
18.
go back to reference Cumming J, Mays N, Gribben B: Reforming primary health care: is New Zealand's primary health care strategy achieving its early goals?. Aust New Zealand Health Policy. 2008, 5 (24): Cumming J, Mays N, Gribben B: Reforming primary health care: is New Zealand's primary health care strategy achieving its early goals?. Aust New Zealand Health Policy. 2008, 5 (24):
19.
go back to reference Abbott JH, Robertson MC, McKenzie JE, Baxter GD, Theis JC, Campbell AJ, the MOA Trial team: Exercise therapy, manual therapy, or both, for osteoarthritis of the hip or knee: a factorial randomised controlled trial protocol. Trials. 2009, 10 (1): 11-10.1186/1745-6215-10-11.CrossRefPubMedPubMedCentral Abbott JH, Robertson MC, McKenzie JE, Baxter GD, Theis JC, Campbell AJ, the MOA Trial team: Exercise therapy, manual therapy, or both, for osteoarthritis of the hip or knee: a factorial randomised controlled trial protocol. Trials. 2009, 10 (1): 11-10.1186/1745-6215-10-11.CrossRefPubMedPubMedCentral
20.
go back to reference Altman DG, Asch E, Bloch D, Bole G, Borenstein D, Brandt K, Christy W, Cooke TD, Greenwald R, Hochberg M, et al: Development of criteria for the classification and reporting of osteoarthritis. Classification of osteoarthritis of the knee. Diagnostic and Therapeutic Criteria Committee of the American Rheumatism Association. Arthitis Rheum. 1986, 29 (8): 1039-1049. 10.1002/art.1780290816.CrossRef Altman DG, Asch E, Bloch D, Bole G, Borenstein D, Brandt K, Christy W, Cooke TD, Greenwald R, Hochberg M, et al: Development of criteria for the classification and reporting of osteoarthritis. Classification of osteoarthritis of the knee. Diagnostic and Therapeutic Criteria Committee of the American Rheumatism Association. Arthitis Rheum. 1986, 29 (8): 1039-1049. 10.1002/art.1780290816.CrossRef
21.
go back to reference Altman R, Alarcon G, Appelrouth D, Bloch D, Borenstein D, Brandt K, Brown C, Cooke TD, Daniel W, Feldman D, et al: The American College of Rheumatology criteria for the classification and reporting of osteoarthritis of the hip. Arthitis Rheum. 1991, 34 (5): 505-514. 10.1002/art.1780340502.CrossRef Altman R, Alarcon G, Appelrouth D, Bloch D, Borenstein D, Brandt K, Brown C, Cooke TD, Daniel W, Feldman D, et al: The American College of Rheumatology criteria for the classification and reporting of osteoarthritis of the hip. Arthitis Rheum. 1991, 34 (5): 505-514. 10.1002/art.1780340502.CrossRef
22.
go back to reference Cochrane T, Davey RC, Matthes Edwards SM: Randomised controlled trial of the cost-effectiveness of water-based therapy for lower limb osteoarthritis. Health Technol Assess. 2005, 9 (31): iii-iv. ix-xi, 1-114CrossRefPubMed Cochrane T, Davey RC, Matthes Edwards SM: Randomised controlled trial of the cost-effectiveness of water-based therapy for lower limb osteoarthritis. Health Technol Assess. 2005, 9 (31): iii-iv. ix-xi, 1-114CrossRefPubMed
23.
go back to reference Lanes SK, Lanza LL, Radensky PW, Yood RA, Meenan RT, Walker AM, Dreyer NA: Resource utilization and cost of care for rheumatoid arthritis and osteoarthritis in a managed care setting: the importance of drug and surgery costs. Arthitis Rheum. 1997, 40 (8): 1475-1481. 10.1002/art.1780400816.CrossRef Lanes SK, Lanza LL, Radensky PW, Yood RA, Meenan RT, Walker AM, Dreyer NA: Resource utilization and cost of care for rheumatoid arthritis and osteoarthritis in a managed care setting: the importance of drug and surgery costs. Arthitis Rheum. 1997, 40 (8): 1475-1481. 10.1002/art.1780400816.CrossRef
24.
go back to reference Mittendorf T, Merkesdal S, Huelsemann JL, von der Schulenburg JM, Zeidler H, Ruof J: Implementing standardized cost categories within economic evaluations in musculoskeletal diseases. Eur J Health Econ. 2003, 4 (1): 43-49. 10.1007/s10198-002-0149-y.CrossRefPubMed Mittendorf T, Merkesdal S, Huelsemann JL, von der Schulenburg JM, Zeidler H, Ruof J: Implementing standardized cost categories within economic evaluations in musculoskeletal diseases. Eur J Health Econ. 2003, 4 (1): 43-49. 10.1007/s10198-002-0149-y.CrossRefPubMed
25.
go back to reference Lagan J, Scott B: The New Zealand Pharmaceutical Schedule. 2009, Wellington: Pharmaceutical Management Agency, 16: 1-224. Lagan J, Scott B: The New Zealand Pharmaceutical Schedule. 2009, Wellington: Pharmaceutical Management Agency, 16: 1-224.
26.
go back to reference Royston P: Multiple Imputation of Missing Values. Stata J. 2005, 5: 527-536. Royston P: Multiple Imputation of Missing Values. Stata J. 2005, 5: 527-536.
27.
go back to reference Horton NJ, Kleinman KP: Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models. Am Stat. 2007, 61 (1): 79-90. 10.1198/000313007X172556.CrossRefPubMedPubMedCentral Horton NJ, Kleinman KP: Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models. Am Stat. 2007, 61 (1): 79-90. 10.1198/000313007X172556.CrossRefPubMedPubMedCentral
28.
go back to reference Lin LI: A Concordance Correlation Coefficient to Evaluate Reproducibility. Biometrics. 1989, 45 (1): 255-268. 10.2307/2532051.CrossRefPubMed Lin LI: A Concordance Correlation Coefficient to Evaluate Reproducibility. Biometrics. 1989, 45 (1): 255-268. 10.2307/2532051.CrossRefPubMed
29.
go back to reference Mirandola M, Bisoffi G, Bonizzato P, Amaddeo F: Collecting psychiatric resources utilisation data to calculate costs of care: a comparison between a service receipt interview and a case register. Soc Psychiatry Psychiatr Epidemiol. 1999, 34: 541-547. 10.1007/s001270050173.CrossRefPubMed Mirandola M, Bisoffi G, Bonizzato P, Amaddeo F: Collecting psychiatric resources utilisation data to calculate costs of care: a comparison between a service receipt interview and a case register. Soc Psychiatry Psychiatr Epidemiol. 1999, 34: 541-547. 10.1007/s001270050173.CrossRefPubMed
30.
go back to reference Cicchetti DV: The precision of reliability, validity estimates revisited: distinguishing between clinical and statistical significance of sample size requirements. J Clin Exp Neuropsychol. 2001, 23: 695-700. 10.1076/jcen.23.5.695.1249.CrossRefPubMed Cicchetti DV: The precision of reliability, validity estimates revisited: distinguishing between clinical and statistical significance of sample size requirements. J Clin Exp Neuropsychol. 2001, 23: 695-700. 10.1076/jcen.23.5.695.1249.CrossRefPubMed
31.
go back to reference Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, i: 307-310. 10.1016/S0140-6736(86)90837-8.CrossRef Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, i: 307-310. 10.1016/S0140-6736(86)90837-8.CrossRef
32.
go back to reference Kirkwood BR, Sterne AC: Essential Medical Statistics. 2003, Oxford: Blackwell Publishing Ltd Kirkwood BR, Sterne AC: Essential Medical Statistics. 2003, Oxford: Blackwell Publishing Ltd
33.
go back to reference Petrou SML, Davidson LL: The accuracy of self-reported healthcare resource utilization in health economic studies. Int J Technol Assess Health Care. 2002, 18 (3): 705-740. 10.1017/S026646230200051X.CrossRefPubMed Petrou SML, Davidson LL: The accuracy of self-reported healthcare resource utilization in health economic studies. Int J Technol Assess Health Care. 2002, 18 (3): 705-740. 10.1017/S026646230200051X.CrossRefPubMed
34.
go back to reference Ruof J, Huelsemann JL, Mittendorf T, Handelmann S, von der Schulenburg JM, Zeidler H, Aultman R, Merkesdal S: Patient-reported health care utilization in rheumatoid arthritis: what level of detail is required?. Arthritis Rheum. 2004, 51 (5): 774-781. 10.1002/art.20686.CrossRefPubMed Ruof J, Huelsemann JL, Mittendorf T, Handelmann S, von der Schulenburg JM, Zeidler H, Aultman R, Merkesdal S: Patient-reported health care utilization in rheumatoid arthritis: what level of detail is required?. Arthritis Rheum. 2004, 51 (5): 774-781. 10.1002/art.20686.CrossRefPubMed
35.
go back to reference Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM: A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol. 2009, 62 (8): 797-806. 10.1016/j.jclinepi.2009.02.005.CrossRefPubMed Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM: A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol. 2009, 62 (8): 797-806. 10.1016/j.jclinepi.2009.02.005.CrossRefPubMed
36.
go back to reference Glick HA, Doshi JA, Sonnad SS, Polsky D: Economic Evaluation in Clinical Trials. 2007, Oxford: Oxford University Press Glick HA, Doshi JA, Sonnad SS, Polsky D: Economic Evaluation in Clinical Trials. 2007, Oxford: Oxford University Press
Metadata
Title
Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis
Authors
Daniel Pinto
M Clare Robertson
Paul Hansen
J Haxby Abbott
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-45

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue