Top

Published in:

Open Access 01-05-2017

Employing quality control and feedback to the EQ-5D-5L valuation protocol to improve the quality of data collection

Authors: Fredrick Dermawan Purba, Joke A. M. Hunfeld, Aulia Iskandarsyah, Titi Sahidah Fitriana, Sawitri S. Sadarjoen, Jan Passchier, Jan J. V. Busschbach

Published in: Quality of Life Research | Issue 5/2017

Abstract

Objectives

In valuing health states using generic questionnaires such as EQ-5D, there are unrevealed issues with the quality of the data collection. The aims were to describe the problems encountered during valuation and to evaluate a quality control report and subsequent retraining of interviewers in improving this valuation.

Methods

Data from the first 266 respondents in an EQ-5D-5L valuation study were used. Interviewers were trained and answered questions regarding problems during these initial interviews. Thematic analysis was used, and individual feedback was provided. After completion of 98 interviews, a first quantitative quality control (QC) report was generated, followed by a 1-day retraining program. Subsequently individual feedback was also given on the basis of follow-up QCs. The Wilcoxon signed-rank test was used to assess improvements based on 7 indicators of quality as identified in the first QC and the QC conducted after a further 168 interviews.

Results

Interviewers encountered problems in recruiting respondents. Solutions provided were: optimization of the time of interview, the use of broader networks and the use of different scripts to explain the project’s goals to respondents. For problems in interviewing process, solutions applied were: developing the technical and personal skills of the interviewers and stimulating the respondents’ thought processes. There were also technical problems related to hardware, software and internet connections. There was an improvement in all 7 indicators of quality after the second QC.

Conclusion

Training before and during a study, and individual feedback on the basis of a quantitative QC, can increase the validity of values obtained from generic questionnaires.

Herdman, M., Gudex, C., Lloyd, A., Janssen, M., Kind, P., Parkin, D., et al. (2011). Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Quality of Life Research, 20(10), 1727–1736. doi:10.1007/s11136-011-9903-x.CrossRefPubMedPubMedCentral

Devlin, N., Shah, K., Feng, Y., Mulhern, B., & van Hout, B. (2015). Valuing health-related quality of life: An EQ-5D-5L value set for England. OHE Research Paper.

Xie, F., Pullenayegum, E., Gaebel, K., Bansback, N., Bryan, S., Ohinmaa, A., et al. (2015). A time trade-off-derived value set of the EQ-5D-5L for Canada. Medical Care.

Augustovski, F., Rey-Ares, L., Irazola, V., Garay, O. U., Gianneo, O., Fernandez, G., et al. (2015). An EQ-5D-5L value set based on Uruguayan population preferences. Quality of Life Research.

Versteegh, M. M., Vermeulen, K. M., Evers, S. M. A. A., de Wit, G. A., Prenger, R., & Stolk, E. A. (2016). Dutch tariff for the five-level version of EQ-5D. Value in Health, 19(4), 343–352. doi:10.1016/j.jval.2016.01.003.CrossRef

Kim, S. H., Ahn, J., Ock, M., Shin, S., Park, J., Luo, N., et al. (2016). The EQ-5D-5L valuation study in Korea. Quality of Life Research, 25(7), 1845–1852. doi:10.1007/s11136-015-1205-2.CrossRefPubMed

Ikeda, S., Shiroiwa, T., Igarashi, A., Noto, S., Fukuda, T., Saito, S., et al. (2015). Developing a Japanese version of the EQ-5D-5L value set (in Japanese). Journal of the National Institute of Public Health, 64, 47–55.

Oppe, M., Devlin, N. J., van Hout, B., Krabbe, P. F., & de Charro, F. (2014). A program of methodological research to arrive at the new international EQ-5D-5L valuation protocol. Value in Health, 17(4), 445–453. doi:10.1016/j.jval.2014.04.002.CrossRefPubMed

Edelaar-Peeters, Y., Stiggelbout, A. M., & Van Den Hout, W. B. (2014). Qualitative and quantitative analysis of interviewer help answering the time tradeoff. Medical Decision Making, 34(5), 655–665. doi:10.1177/0272989x14524989.CrossRefPubMed

10.

Papadimitropoulos, E. A., Elbarazi, I., Blair, I., Katsaiti, M. S., Shah, K. K., & Devlin, N. J. (2015). An investigation of the feasibility and cultural appropriateness of stated preference methods to generate EQ-5D-5L values in the United Arab Emirates. In O. O. H. E. (OHE) (Ed.).

11.

Shah, K. K., Lloyd, A., Oppe, M., & Devlin, N. J. (2013). One-to-one versus group setting for conducting computer-assisted TTO studies: Findings from pilot studies in England and the Netherlands. The European Journal of Health Economics, 14(Suppl 1), S65–S73. doi:10.1007/s10198-013-0509-9.CrossRefPubMed

12.

Xie, F., Gaebel, K., Perampaladas, K., Doble, B., & Pullenayegum, E. (2014). Comparing EQ-5D valuation studies: a systematic review and methodological reporting checklist. Medical Decision Making, 34(1), 8–20. doi:10.1177/0272989x13480852.CrossRefPubMed

13.

Bansback, N., Hole, A. R., Mulhern, B., & Tsuchiya, A. (2014). Testing a discrete choice experiment including duration to value health states for large descriptive systems: Addressing design and sampling issues. Social Science and Medicine, 114, 38–48. doi:10.1016/j.socscimed.2014.05.026.CrossRefPubMedPubMedCentral

14.

Augustovski, F., Rey-Ares, L., Irazola, V., Oppe, M., & Devlin, N. J. (2013). Lead versus lag-time trade-off variants: Does it make any difference? The European Journal of Health Economics, 14(Suppl 1), S25–S31. doi:10.1007/s10198-013-0505-0.CrossRefPubMed

15.

Luo, N., Cheung, Y. B., Ng, R., & Lee, C. F. (2015). Mapping and direct valuation: Do they give equivalent EQ-5D-5L index scores? Health Qual Life Outcomes, 13(1), 166. doi:10.1186/s12955-015-0361-y.CrossRefPubMedPubMedCentral

16.

van Hout, B., Janssen, M. F., Feng, Y. S., Kohlmann, T., Busschbach, J., Golicki, D., et al. (2012). Interim scoring for the EQ-5D-5L: Mapping the EQ-5D-5L to EQ-5D-3L value sets. Value in Health, 15(5), 708–715. doi:10.1016/j.jval.2012.02.008.CrossRefPubMed

17.

Ramos-Goni, J. M., Pinto-Prades, J. L., Oppe, M., Cabases, J. M., Serrano-Aguilar, P., & Rivero-Arias, O. (2014). Valuation and modeling of EQ-5D-5L health states using a hybrid approach. Medical Care. doi:10.1097/mlr.0000000000000283.PubMed

18.

Morgan, D. L. (2006). Quota sampling. The sage encyclopedia of qualitative research methods. Thousand Oaks, CA: SAGE Publications Inc.

19.

Janssen, B. M., Oppe, M., Versteegh, M. M., & Stolk, E. A. (2013). Introducing the composite time trade-off: A test of feasibility and face validity. The European Journal of Health Economics, 14(Suppl 1), S5–S13.CrossRefPubMed

20.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3, 77–101. doi:10.1191/1478088706qp063oa.CrossRef

21.

Galea, S., & Tracy, M. (2007). Participation rates in epidemiologic studies. Annals of Epidemiology, 17(9), 643–653.CrossRefPubMed

22.

Slegers, C., Zion, D., Glass, D., Kelsall, H., Fritschi, L., Brown, N., et al. (2015). Why do people participate in epidemiological research? Journal of Bioethical Inquiry, 12(2), 227–237.CrossRefPubMed

23.

Stem, D. E., & Bozman, C. S. (1988). Respondent anxiety reduction with the randomized response technique. In M. J. Houston (Ed.), NA-advances in consumer research, vol. 15 (pp. 595–599). Association for Consumer Research.

24.

Birks, M. J., Chapman, Y., & Francis, K. (2007). Breaching the wall: Interviewing people from other cultures. Journal of Transcultural Nursing, 18(2), 150–156. doi:10.1177/1043659606298617.CrossRefPubMed

25.

Kaiser, W., Burow, S., Dahms, M., Lund, H., Nast, J., & Zindel, K. (1998). Interviewer effects in assessing subjective quality of life and satisfaction with care in sheltered housing. Psychiatrische Praxis, 25(3), 142–148.PubMed

26.

Kroeger, A. (1983). Health interview surveys in developing countries: A review of the methods and results. International Journal of Epidemiology, 12(4), 465–481.CrossRefPubMed

27.

Fryer, C., Mackintosh, S., Stanley, M., & Crichton, J. (2012). Qualitative studies using in-depth interviews with older people from multiple language groups: Methodological systematic review. Journal of Advanced Nursing, 68(1), 22–35. doi:10.1111/j.1365-2648.2011.05719.x.CrossRefPubMed

28.

Patton, M. Q. (2002). Qualitative research & evaluation methods (3rd ed.). Thousand Oaks, CA: SAGE Publications Inc.

29.

Sallquist, J., Eisenberg, N., French, D. C., Purwono, U., & Suryanti, T. A. (2010). Indonesian adolescents’ spiritual and religious experiences and their longitudinal relations with socioemotional functioning. Developmental Psychology, 46(3), 699–716. doi:10.1037/a0018879.CrossRefPubMed

30.

Wee, H. L., Li, S. C., Xie, F., Zhang, X. H., Luo, N., Feeny, D., et al. (2008). Validity, feasibility and acceptability of time trade-off and standard gamble assessments in health valuation studies: a study in a multiethnic Asian population in Singapore. Value in Health, 11(Suppl 1), S3–S10.CrossRefPubMed

31.

Yusof, F. A., Goh, A., & Azmi, S. (2012). Estimating an EQ-5D value set for Malaysia using time trade-off and visual analogue scale methods. Value in Health, 15(1 Suppl), S85–S90.CrossRefPubMed

32.

Ogilvie, L. D., Burgess-Pinto, E., & Caufield, C. (2008). Challenges and approaches to newcomer health research. Journal of Transcultural Nursing, 19(1), 64–73. doi:10.1177/1043659607309142.CrossRefPubMed

Title: Employing quality control and feedback to the EQ-5D-5L valuation protocol to improve the quality of data collection
Authors: Fredrick Dermawan Purba
Joke A. M. Hunfeld
Aulia Iskandarsyah
Titi Sahidah Fitriana
Sawitri S. Sadarjoen
Jan Passchier
Jan J. V. Busschbach
Publication date: 01-05-2017
Publisher: Springer International Publishing
Published in: Quality of Life Research / Issue 5/2017
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI: https://doi.org/10.1007/s11136-016-1445-9

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Employing quality control and feedback to the EQ-5D-5L valuation protocol to improve the quality of data collection

Abstract

Objectives

Methods

Results

Conclusion

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Objectives

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 5/2017

A review of the application, feasibility, and the psychometric properties of the individualized measures in cancer

Factors associated with the quality of life of mothers of preterm infants with very low birth weight: a 3-year follow-up study

Objectively measured sedentary behavior and moderate-to-vigorous physical activity on the health-related quality of life in US adults: The National Health and Nutrition Examination Survey 2003–2006

Factors associated with health-related quality of life (HRQOL) in adults with short stature skeletal dysplasias

Evaluating and establishing national norms for mental wellbeing using the short Warwick–Edinburgh Mental Well-being Scale (SWEMWBS): findings from the Health Survey for England

Investigating acculturation orientations of patients with an immigration background and doctors in Canada: implications for medical advice adherence