Skip to main content
Top
Published in: BMC Health Services Research 1/2013

Open Access 01-12-2013 | Research article

Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P)

Authors: Clazien Bouwmans, Kim De Jong, Reinier Timman, Moniek Zijlstra-Vlasveld, Christina Van der Feltz-Cornelis, Siok Swan Tan, Leona Hakkaart-van Roijen

Published in: BMC Health Services Research | Issue 1/2013

Login to get access

Abstract

Background

Patient self-report allows collecting comprehensive data for the purpose of performing economic evaluations. The aim of the current study was to assess the feasibility, reliability and a part of the construct validity of a commonly applied questionnaire on healthcare utilization and productivity losses in patients with a psychiatric disorder (TiC-P).

Methods

Data were derived alongside two clinical trials performed in the Netherlands in patients with mental health problems. The response rate, average time of filling out the questionnaire and proportions of missing values were used as indicators of feasibility of the questionnaire. Test-retest analyses were performed including Cohen’s kappa and intra class correlation coefficients to assess reliability of the data. The construct validity was assessed by comparing patient reported data on contacts with psychotherapists and reported data on long-term absence from work with data derived from registries.

Results

The response rate was 72%. The mean time needed for filling out the first TiC-P was 9.4 minutes. The time needed for filling out the questionnaire was 2.3 minutes less for follow up measurements. Proportions of missing values were limited (< 2.4%) except for medication for which in 10% of the cases costs could not be calculated. Cohen’s kappa was satisfactory to almost perfect for most items related to healthcare consumption and satisfactory for items on absence from work and presenteeism. Comparable results were shown by the ICCs on variables measuring volumes of medical consumption and productivity losses indicating good reliability of the questionnaire.
Absolute agreement between patient-reported data and data derived from medical registrations of the psychotherapists was satisfactory. Accepting a margin of +/− seven days, the agreement on reported and registered data on long-term absence from work was satisfactory. The validity of self-reported data using the TiC-P is promising.

Conclusions

The results indicate that the TiC-P is a feasible and reliable instrument for collecting data on medical consumption and productivity losses in patients with mild to moderate mental health problems. Additionally, the construct validity of questions related to contacts with psychotherapist and long-term absence from work was satisfactory.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jonsson B: Ten arguments for a societal perspective in the economic evaluation of medical innovations. Eur J Health Econ. 2009, 10 (4): 357-359. 10.1007/s10198-009-0173-2.CrossRefPubMed Jonsson B: Ten arguments for a societal perspective in the economic evaluation of medical innovations. Eur J Health Econ. 2009, 10 (4): 357-359. 10.1007/s10198-009-0173-2.CrossRefPubMed
2.
go back to reference Knies S, Severens JL, Ament AJ, Evers SM: The transferability of valuing lost productivity across jurisdictions. Differences between national pharmacoeconomic guidelines. Value Health. 2010, 13 (5): 519-527. 10.1111/j.1524-4733.2010.00699.x.CrossRefPubMed Knies S, Severens JL, Ament AJ, Evers SM: The transferability of valuing lost productivity across jurisdictions. Differences between national pharmacoeconomic guidelines. Value Health. 2010, 13 (5): 519-527. 10.1111/j.1524-4733.2010.00699.x.CrossRefPubMed
3.
go back to reference Hjelmgren J, Berggren F, Andersson F: Health economic guidelines–similarities, differences and some implications. Value Health. 2001, 4 (3): 225-250. 10.1046/j.1524-4733.2001.43040.x.CrossRefPubMed Hjelmgren J, Berggren F, Andersson F: Health economic guidelines–similarities, differences and some implications. Value Health. 2001, 4 (3): 225-250. 10.1046/j.1524-4733.2001.43040.x.CrossRefPubMed
4.
go back to reference Tan SS, Bouwmans CAM, Rutten FF, Hakkaart-van Roijen L: Update of the Dutch Manual for Costing in Economic Evaluations. Int J Technol Assess Health Care. 2012, 28 (2): 152-158. 10.1017/S0266462312000062.CrossRefPubMed Tan SS, Bouwmans CAM, Rutten FF, Hakkaart-van Roijen L: Update of the Dutch Manual for Costing in Economic Evaluations. Int J Technol Assess Health Care. 2012, 28 (2): 152-158. 10.1017/S0266462312000062.CrossRefPubMed
5.
go back to reference Drummond MF, Sculpher MJ, Torrence GW, O’Brien BJ, Stoddart GL: Methods for the Economic Evaluation of health Care Programmes: third ed. 2005, Oxford: Oxford University Press Drummond MF, Sculpher MJ, Torrence GW, O’Brien BJ, Stoddart GL: Methods for the Economic Evaluation of health Care Programmes: third ed. 2005, Oxford: Oxford University Press
6.
go back to reference Riley GF: Administrative and claims records as sources of health care cost data. Med Care. 2009, 47 (7 Suppl 1): S51-S55.CrossRefPubMed Riley GF: Administrative and claims records as sources of health care cost data. Med Care. 2009, 47 (7 Suppl 1): S51-S55.CrossRefPubMed
7.
go back to reference Sevilla-Dedieu C, Kovess-Masfety V, Angermeyer M, Bruffaerts R, Fernandez A, Girolamo GD, De Graaf R, Haro JM, Konig HH, The ESEMED/MHEDEA 2000 Investigators: Measuring use of services for mental health problems in epidemiological surveys. Int J Methods Psychiatr Res. 2011, 20 (3): 182-191.PubMed Sevilla-Dedieu C, Kovess-Masfety V, Angermeyer M, Bruffaerts R, Fernandez A, Girolamo GD, De Graaf R, Haro JM, Konig HH, The ESEMED/MHEDEA 2000 Investigators: Measuring use of services for mental health problems in epidemiological surveys. Int J Methods Psychiatr Res. 2011, 20 (3): 182-191.PubMed
8.
go back to reference Wang PS, Aguilar-Gaxiola S, Alonso J, Angermeyer MC, Borges G, Bromet EJ, Bruffaerts R, De Girolamo G, De Graaf R, Gureje O, Haro JM, Karam EG, Kessler RC, Kovess V, Lane MC, Lee S, Levinson D, Ono Y, Petukhova M, Posada-Villa J, Seedat S, Wells JE: Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. Lancet. 2007, 370 (9590): 841-850. 10.1016/S0140-6736(07)61414-7.CrossRefPubMedPubMedCentral Wang PS, Aguilar-Gaxiola S, Alonso J, Angermeyer MC, Borges G, Bromet EJ, Bruffaerts R, De Girolamo G, De Graaf R, Gureje O, Haro JM, Karam EG, Kessler RC, Kovess V, Lane MC, Lee S, Levinson D, Ono Y, Petukhova M, Posada-Villa J, Seedat S, Wells JE: Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. Lancet. 2007, 370 (9590): 841-850. 10.1016/S0140-6736(07)61414-7.CrossRefPubMedPubMedCentral
9.
go back to reference Van den Brink M, Van den Hout WB, Stiggelbout AM, Putter H, Van de Velde CJ, Kievit J: Self-reports of health-care utilization: diary or questionnaire?. Int J Technol Assess Health Care. 2005, 21 (3): 298-304.CrossRefPubMed Van den Brink M, Van den Hout WB, Stiggelbout AM, Putter H, Van de Velde CJ, Kievit J: Self-reports of health-care utilization: diary or questionnaire?. Int J Technol Assess Health Care. 2005, 21 (3): 298-304.CrossRefPubMed
10.
go back to reference Goossens ME, Rutten-van Molken MP, Vlaeyen JW, Van der Linden SM: The cost diary: a method to measure direct and indirect costs in cost-effectiveness research. J Clin Epidemiol. 2000, 53 (7): 688-695. 10.1016/S0895-4356(99)00177-8.CrossRefPubMed Goossens ME, Rutten-van Molken MP, Vlaeyen JW, Van der Linden SM: The cost diary: a method to measure direct and indirect costs in cost-effectiveness research. J Clin Epidemiol. 2000, 53 (7): 688-695. 10.1016/S0895-4356(99)00177-8.CrossRefPubMed
11.
go back to reference Hakkaart-van Roijen L, Van Straten A, Al M, Rutten F, Donker M: Cost-utility of brief psychological treatment for depression and anxiety. Br J Psychiatry. 2006, 188: 323-329. 10.1192/bjp.188.4.323.CrossRef Hakkaart-van Roijen L, Van Straten A, Al M, Rutten F, Donker M: Cost-utility of brief psychological treatment for depression and anxiety. Br J Psychiatry. 2006, 188: 323-329. 10.1192/bjp.188.4.323.CrossRef
12.
go back to reference Polak AR, Witteveen AB, Visser RS, Opmeer BC, Vulink N, Figee M, Denys D, Olff M: Comparison of the effectiveness of trauma-focused cognitive behavioral therapy and paroxetine treatment in PTSD patients: design of a randomized controlled trial. BMC Psychiatry. 2012, 12: 166-10.1186/1471-244X-12-166.CrossRefPubMedPubMedCentral Polak AR, Witteveen AB, Visser RS, Opmeer BC, Vulink N, Figee M, Denys D, Olff M: Comparison of the effectiveness of trauma-focused cognitive behavioral therapy and paroxetine treatment in PTSD patients: design of a randomized controlled trial. BMC Psychiatry. 2012, 12: 166-10.1186/1471-244X-12-166.CrossRefPubMedPubMedCentral
13.
go back to reference Berghout CC, Zevalkink J, Hakkaart-Van Roijen L: The effects of long-term psychoanalytic treatment on healthcare utilization and work impairment and their associated costs. J Psychiatr Pract. 2010, 16 (4): 209-216. 10.1097/01.pra.0000386907.99536.75.CrossRefPubMed Berghout CC, Zevalkink J, Hakkaart-Van Roijen L: The effects of long-term psychoanalytic treatment on healthcare utilization and work impairment and their associated costs. J Psychiatr Pract. 2010, 16 (4): 209-216. 10.1097/01.pra.0000386907.99536.75.CrossRefPubMed
14.
go back to reference Horn EK, Van Benthem TB, Hakkaart-van Roijen L, Van Marwijk HW, Beekman AT, Rutten FF, Van der Feltz-Cornelis CM: Cost-effectiveness of collaborative care for chronically ill patients with comorbid depressive disorder in the general hospital setting, a randomised controlled trial. BMC Health Serv Res. 2007, 7: 28-10.1186/1472-6963-7-28.CrossRefPubMedPubMedCentral Horn EK, Van Benthem TB, Hakkaart-van Roijen L, Van Marwijk HW, Beekman AT, Rutten FF, Van der Feltz-Cornelis CM: Cost-effectiveness of collaborative care for chronically ill patients with comorbid depressive disorder in the general hospital setting, a randomised controlled trial. BMC Health Serv Res. 2007, 7: 28-10.1186/1472-6963-7-28.CrossRefPubMedPubMedCentral
17.
go back to reference Roijen VL, Essink-Bot M, Koopmanschap M, Bonsel G, Rutten F: Labor and health status in economic evaluation of health care. The Health and Labor Questionnaire. Int J Technol Assess Health Care. 1996, 12 (3): 405-415. 10.1017/S0266462300009764.CrossRefPubMed Roijen VL, Essink-Bot M, Koopmanschap M, Bonsel G, Rutten F: Labor and health status in economic evaluation of health care. The Health and Labor Questionnaire. Int J Technol Assess Health Care. 1996, 12 (3): 405-415. 10.1017/S0266462300009764.CrossRefPubMed
18.
go back to reference De Jong K: A chance for change: building an outcome monitoring feedback system for outpatient mental health care. 2012, PhD thesis.Leiden University, Department of Clinical Health and Neuropsychology De Jong K: A chance for change: building an outcome monitoring feedback system for outpatient mental health care. 2012, PhD thesis.Leiden University, Department of Clinical Health and Neuropsychology
19.
go back to reference Vlasveld MC, Van der Feltz-Cornelis CM, Ader HJ, Anema JR, Hoedeman R, Van Mechelen W, Beekman AT: Collaborative care for major depressive disorder in an occupational healthcare setting. Br J Psychiatry. 2012, 200 (6): 510-511. 10.1192/bjp.bp.111.095687.CrossRefPubMed Vlasveld MC, Van der Feltz-Cornelis CM, Ader HJ, Anema JR, Hoedeman R, Van Mechelen W, Beekman AT: Collaborative care for major depressive disorder in an occupational healthcare setting. Br J Psychiatry. 2012, 200 (6): 510-511. 10.1192/bjp.bp.111.095687.CrossRefPubMed
20.
go back to reference Altman D: Practical statistics for medical research. 1991, London: Chapman & Hall Altman D: Practical statistics for medical research. 1991, London: Chapman & Hall
21.
go back to reference Al Mahdy H, Seymour DG: How much can elderly patients tell us about their medications?. Postgrad Med J. 1990, 66 (772): 116-121. 10.1136/pgmj.66.772.116.CrossRefPubMedPubMedCentral Al Mahdy H, Seymour DG: How much can elderly patients tell us about their medications?. Postgrad Med J. 1990, 66 (772): 116-121. 10.1136/pgmj.66.772.116.CrossRefPubMedPubMedCentral
22.
go back to reference Pinto D, Robertson MC, Hansen P, Abbott JH: Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis. BMC Med Res Methodol. 2011, 11: 45-10.1186/1471-2288-11-45.CrossRefPubMedPubMedCentral Pinto D, Robertson MC, Hansen P, Abbott JH: Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis. BMC Med Res Methodol. 2011, 11: 45-10.1186/1471-2288-11-45.CrossRefPubMedPubMedCentral
23.
go back to reference Severens J, Mulder J, Laheij R, AL AV: Precision and accuracy in measuring absence from work as a basis for calculating productivity costs in The Netherlands. Soc Sci Med. 2000, 51 (2): 243-249. 10.1016/S0277-9536(99)00452-9.CrossRefPubMed Severens J, Mulder J, Laheij R, AL AV: Precision and accuracy in measuring absence from work as a basis for calculating productivity costs in The Netherlands. Soc Sci Med. 2000, 51 (2): 243-249. 10.1016/S0277-9536(99)00452-9.CrossRefPubMed
24.
go back to reference Van Poppel MN, De Vet HC, Koes BW, Smid T, Bouter LM: Measuring sick leave: a comparison of self-reported data on sick leave and data from company records. Occup Med (Lond). 2002, 52 (8): 485-490. 10.1093/occmed/52.8.485.CrossRef Van Poppel MN, De Vet HC, Koes BW, Smid T, Bouter LM: Measuring sick leave: a comparison of self-reported data on sick leave and data from company records. Occup Med (Lond). 2002, 52 (8): 485-490. 10.1093/occmed/52.8.485.CrossRef
25.
go back to reference Ferrie JE, Kivimaki M, Head J, Shipley MJ, Vahtera J, Marmot MG: A comparison of self-reported sickness absence with absences recorded in employers’ registers: evidence from the Whitehall II study. Occup Environ Med. 2005, 62 (2): 74-79. 10.1136/oem.2004.013896.CrossRefPubMedPubMedCentral Ferrie JE, Kivimaki M, Head J, Shipley MJ, Vahtera J, Marmot MG: A comparison of self-reported sickness absence with absences recorded in employers’ registers: evidence from the Whitehall II study. Occup Environ Med. 2005, 62 (2): 74-79. 10.1136/oem.2004.013896.CrossRefPubMedPubMedCentral
Metadata
Title
Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P)
Authors
Clazien Bouwmans
Kim De Jong
Reinier Timman
Moniek Zijlstra-Vlasveld
Christina Van der Feltz-Cornelis
Siok Swan Tan
Leona Hakkaart-van Roijen
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2013
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-13-217

Other articles of this Issue 1/2013

BMC Health Services Research 1/2013 Go to the issue