Skip to main content
Top
Published in: BMC Health Services Research 1/2012

Open Access 01-12-2012 | Research article

Pre-test of questions on health-related resource use and expenditure, using behaviour coding and cognitive interviewing techniques

Published in: BMC Health Services Research | Issue 1/2012

Login to get access

Abstract

Background

Validated instruments collecting data on health-related resource use are lacking, but required, for example, to investigate predictors of healthcare use or for health economic evaluation.
The objective of the study was to develop, test and refine a questionnaire collecting data on health-related resource use and expenditure in patients with diabetes.

Methods

The questionnaire was tested in 43 patients with diabetes mellitus types 1 and 2 in Germany. Response behaviour suggestive of problems with questions (item non-response, request for clarification, comments, inadequate answer, “don’t know”) was systematically registered. Cognitive interviews focusing on information retrieval and comprehension problems were carried out.

Results

Many participants had difficulties answering questions pertaining to frequency of visits to the general practitioner (26%), time spent receiving healthcare services (39%), regular medication currently taken (35%) and out of pocket expenditure on medication (42%). These difficulties seem to result mainly from poor memory. A number of comprehension problems were established and relevant questions were revised accordingly.

Conclusion

The questionnaire on health-related resource use and expenditure for use in diabetes research in Germany was developed and refined after careful testing. Ideally, the questionnaire should be externally validated for different modes of administration and recall periods within a variety of populations.
Appendix
Available only for authorised users
Literature
1.
go back to reference Johnston K, Buxton MJ, Jones DR, Fitzpatrick R: Assessing the costs of healthcare technologies in clinical trials. Health Technol Assess. 1999, 3: 1-76.PubMed Johnston K, Buxton MJ, Jones DR, Fitzpatrick R: Assessing the costs of healthcare technologies in clinical trials. Health Technol Assess. 1999, 3: 1-76.PubMed
2.
go back to reference Bhandari A, Wagner T: Self-reported utilization of health care services: improving measurement and accuracy. Med CareRes and Rev. 2006, 63: 217-235. 10.1177/1077558705285298.CrossRef Bhandari A, Wagner T: Self-reported utilization of health care services: improving measurement and accuracy. Med CareRes and Rev. 2006, 63: 217-235. 10.1177/1077558705285298.CrossRef
3.
go back to reference Bertoldi AD, Barros AJ, Wagner A, Ross-Degnan D, Hallal PC: A descriptive review of the methodologies used in household surveys on medicine utilization. BMC Health Serv Res. 2008, 8: 222-10.1186/1472-6963-8-222.CrossRefPubMedPubMedCentral Bertoldi AD, Barros AJ, Wagner A, Ross-Degnan D, Hallal PC: A descriptive review of the methodologies used in household surveys on medicine utilization. BMC Health Serv Res. 2008, 8: 222-10.1186/1472-6963-8-222.CrossRefPubMedPubMedCentral
4.
go back to reference Paterson C, Britten N: A narrative review shows the unvalidated use of self-report questionnaires for individual medication as outcome measures. J Clin Epidemiol. 2005, 58: 967-973. 10.1016/j.jclinepi.2005.03.012.CrossRefPubMed Paterson C, Britten N: A narrative review shows the unvalidated use of self-report questionnaires for individual medication as outcome measures. J Clin Epidemiol. 2005, 58: 967-973. 10.1016/j.jclinepi.2005.03.012.CrossRefPubMed
5.
go back to reference Holle R, Happich M, Löwel H, Wichmann HE, MONICA/KORA Study Group: KORA - a research platform for population based health research. Gesundheitswesen. 2005, 67 (Suppl1): 19-25. AugCrossRef Holle R, Happich M, Löwel H, Wichmann HE, MONICA/KORA Study Group: KORA - a research platform for population based health research. Gesundheitswesen. 2005, 67 (Suppl1): 19-25. AugCrossRef
6.
go back to reference Stang A, Moebus S, Dragano N, Beck EM, Möhlenkamp S, Schmermund A, Siegrist J, Erbel R, Jöckel KH: Baseline recruitment and analyses of nonresponse of the Heinz Nixdorf Recall Study: identifiability of phone numbers as the major determinant of response. Eur J Epidemiol. 2005, 20: 489-496. 10.1007/s10654-005-5529-z.CrossRefPubMed Stang A, Moebus S, Dragano N, Beck EM, Möhlenkamp S, Schmermund A, Siegrist J, Erbel R, Jöckel KH: Baseline recruitment and analyses of nonresponse of the Heinz Nixdorf Recall Study: identifiability of phone numbers as the major determinant of response. Eur J Epidemiol. 2005, 20: 489-496. 10.1007/s10654-005-5529-z.CrossRefPubMed
7.
go back to reference Willis GB: Cognitive Interviewing: A Tool for Improving Questionnaire Design. 2005, Thousand Oaks: Sage PublicationsCrossRef Willis GB: Cognitive Interviewing: A Tool for Improving Questionnaire Design. 2005, Thousand Oaks: Sage PublicationsCrossRef
8.
go back to reference Oksenberg L, Cannell C, Kalton G: New Strategies for pretesting survey questions. J of Off Stat. 1991, 7 (3): 349-365. Oksenberg L, Cannell C, Kalton G: New Strategies for pretesting survey questions. J of Off Stat. 1991, 7 (3): 349-365.
9.
go back to reference Fowler FJ: Improving Survey Questions. 1995, Thousand Oaks: Sage Publications Fowler FJ: Improving Survey Questions. 1995, Thousand Oaks: Sage Publications
10.
go back to reference Van der Zouwen J, Smit JH: Evaluating Survey Questions by Analyzing Patterns of Behavior Codes and Question–Answer Sequences: A Diagnostic Approach. Methods for Testing and Evaluating Survey Questionnaires. Edited by: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Hoboken SE. 2004, NJ, USA: John Wiley & Sons Van der Zouwen J, Smit JH: Evaluating Survey Questions by Analyzing Patterns of Behavior Codes and Question–Answer Sequences: A Diagnostic Approach. Methods for Testing and Evaluating Survey Questionnaires. Edited by: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Hoboken SE. 2004, NJ, USA: John Wiley & Sons
11.
go back to reference Tuttle AD, Morrison RL, Willimack DK: From start to pilot: A multi-method approach to the comprehensive redesign of an Economic Survey Questionnaire. J of Off Stat. 2010, 26 (1): 87-103. Tuttle AD, Morrison RL, Willimack DK: From start to pilot: A multi-method approach to the comprehensive redesign of an Economic Survey Questionnaire. J of Off Stat. 2010, 26 (1): 87-103.
12.
go back to reference Presser S, Couper MP, Lessler JT, Martin E, Martin J, Rothgeb JM, Singer E: Methods for Testing and Evaluating Survey Questions. Public Opin Q. 2004, 68: 109-130. 10.1093/poq/nfh008.CrossRef Presser S, Couper MP, Lessler JT, Martin E, Martin J, Rothgeb JM, Singer E: Methods for Testing and Evaluating Survey Questions. Public Opin Q. 2004, 68: 109-130. 10.1093/poq/nfh008.CrossRef
13.
go back to reference Jobe JB: Cognitive psychology and self-reports: models and methods. Qual Life Res. 2003, 12: 219-227. 10.1023/A:1023279029852.CrossRefPubMed Jobe JB: Cognitive psychology and self-reports: models and methods. Qual Life Res. 2003, 12: 219-227. 10.1023/A:1023279029852.CrossRefPubMed
14.
go back to reference Collins D: Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003, 12: 229-238. 10.1023/A:1023254226592.CrossRefPubMed Collins D: Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003, 12: 229-238. 10.1023/A:1023254226592.CrossRefPubMed
Metadata
Title
Pre-test of questions on health-related resource use and expenditure, using behaviour coding and cognitive interviewing techniques
Publication date
01-12-2012
Published in
BMC Health Services Research / Issue 1/2012
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-12-303

Other articles of this Issue 1/2012

BMC Health Services Research 1/2012 Go to the issue