Skip to main content
Top
Published in: BMC Pediatrics 1/2018

Open Access 01-12-2018 | Research article

Testing the feasibility of eliciting preferences for health states from adolescents using direct methods

Authors: R. Trafford Crump, Ryan Lau, Elizabeth Cox, Gillian Currie, Julie Panepinto

Published in: BMC Pediatrics | Issue 1/2018

Login to get access

Abstract

Background

Measuring adolescents’ preferences for health states can play an important role in evaluating the delivery of pediatric healthcare. However, formal evaluation of the common direct preference elicitation methods for health states has not been done with adolescents. Therefore, the purpose of this study is to test how these methods perform in terms of their feasibility, reliability, and validity for measuring health state preferences in adolescents.

Methods

This study used a web-based survey of adolescents, 18 years of age or younger, living in the United States. The survey included four health states, each comprised of six attributes. Preferences for these health states were elicited using the visual analogue scale, time trade-off, and standard gamble. The feasibility, test-retest reliability, and construct validity of each of these preference elicitation methods were tested and compared.

Results

A total of 144 participants were included in this study. Using a web-based survey format to elicit preferences for health states from adolescents was feasible. A majority of participants completed all three elicitation methods, ranked those methods as being easy, with very few requiring assistance from someone else. However, all three elicitation methods demonstrated weak test-retest reliability, with Kendall’s tau-a values ranging from 0.204 to 0.402. Similarly, all three methods demonstrated poor construct validity, with 9–50% of all rankings aligning with our expectations. There were no significant differences across age groups.

Conclusions

Using a web-based survey format to elicit preferences for health states from adolescents is feasible. However, the reliability and construct validity of the methods used to elicit these preferences when using this survey format are poor. Further research into the effects of a web-based survey approach to eliciting preferences for health states from adolescents is needed before health services researchers or pediatric clinicians widely employ these methods.
Appendix
Available only for authorised users
Literature
1.
go back to reference Llewellyn-Thomas H. Health state descriptions: purposes, issues, a proposal. Med Care. 1996;34:DS109–18.PubMed Llewellyn-Thomas H. Health state descriptions: purposes, issues, a proposal. Med Care. 1996;34:DS109–18.PubMed
2.
go back to reference Froberg DG, Kane RL. Methodology for measuring health-state preference-I: measurement strategies. J Clin Epidemiol. 1989;42:345–54.CrossRefPubMed Froberg DG, Kane RL. Methodology for measuring health-state preference-I: measurement strategies. J Clin Epidemiol. 1989;42:345–54.CrossRefPubMed
3.
go back to reference Drummond M, O’Brien B, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. New York: Oxford University Press; 2000. Drummond M, O’Brien B, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. New York: Oxford University Press; 2000.
4.
go back to reference Janus S, Weernink M, van Til J, Raisch D, van Manen, JG IJzerman M. A systematic review to identify the use of preference elicitation methods in health care decision making. ISPOR 17th Annu Eur Congr. Amsterdam, The Netherlands: International Society for Pharmacoeconomics and Outcomes Research (ISPOR); 2014. p. PIH66. Janus S, Weernink M, van Til J, Raisch D, van Manen, JG IJzerman M. A systematic review to identify the use of preference elicitation methods in health care decision making. ISPOR 17th Annu Eur Congr. Amsterdam, The Netherlands: International Society for Pharmacoeconomics and Outcomes Research (ISPOR); 2014. p. PIH66.
5.
go back to reference Froberg DG, Kane RL. Methodology for measuring health-state preferences-II: scaling methods. J Clin Epidemiol. 1989;42:459–71.CrossRefPubMed Froberg DG, Kane RL. Methodology for measuring health-state preferences-II: scaling methods. J Clin Epidemiol. 1989;42:459–71.CrossRefPubMed
6.
go back to reference de Bekker-Grob EW, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ. 2012;21:145–72.CrossRefPubMed de Bekker-Grob EW, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ. 2012;21:145–72.CrossRefPubMed
7.
go back to reference Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, et al. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res. 2012;14:1–14.CrossRef Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, et al. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res. 2012;14:1–14.CrossRef
8.
go back to reference Ramo DE, Prochaska JJ. Broad reach and targeted recruitment using Facebook for an online survey of young adult substance use. J Med Internet Res. 2012;14:1–10.CrossRef Ramo DE, Prochaska JJ. Broad reach and targeted recruitment using Facebook for an online survey of young adult substance use. J Med Internet Res. 2012;14:1–10.CrossRef
9.
go back to reference Close S, Smaldone A, Fennoy I, Reame N, Grey M. Using information technology and social networking for recruitment of research participants: experience from an exploratory study of pediatric klinefelter syndrome. J Med Internet Res. 2013;15:1–11.CrossRef Close S, Smaldone A, Fennoy I, Reame N, Grey M. Using information technology and social networking for recruitment of research participants: experience from an exploratory study of pediatric klinefelter syndrome. J Med Internet Res. 2013;15:1–11.CrossRef
10.
go back to reference Chu JL, Snider CE. Use of a social networking web site for recruiting Canadian youth for medical research. J Adolesc Health. 2013;52:792–4.CrossRefPubMed Chu JL, Snider CE. Use of a social networking web site for recruiting Canadian youth for medical research. J Adolesc Health. 2013;52:792–4.CrossRefPubMed
11.
go back to reference Petrou S. Methodological issues raised by preference-based approaches to measuring the health status of children. Health Econ. 2003;12:697–702.CrossRefPubMed Petrou S. Methodological issues raised by preference-based approaches to measuring the health status of children. Health Econ. 2003;12:697–702.CrossRefPubMed
12.
go back to reference Tarride J-E, Burke N, Bischof M, Hopkins RB, Goeree L, Campbell K, et al. A review of health utilities across conditions common in paediatric and adult populations. Health Qual Life Outcomes. 2010;8:12.CrossRefPubMedPubMedCentral Tarride J-E, Burke N, Bischof M, Hopkins RB, Goeree L, Campbell K, et al. A review of health utilities across conditions common in paediatric and adult populations. Health Qual Life Outcomes. 2010;8:12.CrossRefPubMedPubMedCentral
13.
go back to reference Prosser LA, Hammitt JK, Keren R. Measuring health preferences for use in cost-utility and cost-benefit analyses of interventions in children: theoretical and methodological considerations. PharmacoEconomics. 2007;25:713–26.CrossRefPubMed Prosser LA, Hammitt JK, Keren R. Measuring health preferences for use in cost-utility and cost-benefit analyses of interventions in children: theoretical and methodological considerations. PharmacoEconomics. 2007;25:713–26.CrossRefPubMed
14.
go back to reference Juniper EFF, Guyatt GHH, Feeny DHH, Griffith LEE, Ferrie PJJ. Minimum skills required by children to complete health-related quality of life instruments for asthma: comparison of measurement properties. Eur Respir J. 1997;10:2285–94.CrossRefPubMed Juniper EFF, Guyatt GHH, Feeny DHH, Griffith LEE, Ferrie PJJ. Minimum skills required by children to complete health-related quality of life instruments for asthma: comparison of measurement properties. Eur Respir J. 1997;10:2285–94.CrossRefPubMed
15.
go back to reference Arbuckle R, Abetz-Webb L. “Not just little adults”: qualitative methods to support the development of pediatric patient-reported outcomes. Patient. 2013;6:143–59.CrossRefPubMed Arbuckle R, Abetz-Webb L. “Not just little adults”: qualitative methods to support the development of pediatric patient-reported outcomes. Patient. 2013;6:143–59.CrossRefPubMed
16.
go back to reference Sung L, Young NL, Greenberg ML, McLimont M, Samanta T, Wong J, et al. Health-related quality of life (HRQL) scores reported from parents and their children with chronic illness differed depending on utility elicitation method. J Clin Epidemiol. 2004;57:1161–6.CrossRefPubMed Sung L, Young NL, Greenberg ML, McLimont M, Samanta T, Wong J, et al. Health-related quality of life (HRQL) scores reported from parents and their children with chronic illness differed depending on utility elicitation method. J Clin Epidemiol. 2004;57:1161–6.CrossRefPubMed
17.
go back to reference Kwon J, Kim SW, Ungar WJ, Tsiplova K, Madan J, Petrou S. A systematic review and meta-analysis of childhood health utilities. Med Decis Mak. 2017;38:277–305.CrossRef Kwon J, Kim SW, Ungar WJ, Tsiplova K, Madan J, Petrou S. A systematic review and meta-analysis of childhood health utilities. Med Decis Mak. 2017;38:277–305.CrossRef
18.
19.
go back to reference Crump R, Beverung L, Lau R, Sieracki R, Nicholson M. Reliability, validity, and feasibility of direct elicitation of children’s preferences for health states: a systematic review. Med Decis Mak. 2017;37:314–26.CrossRef Crump R, Beverung L, Lau R, Sieracki R, Nicholson M. Reliability, validity, and feasibility of direct elicitation of children’s preferences for health states: a systematic review. Med Decis Mak. 2017;37:314–26.CrossRef
20.
go back to reference PROMIS Health Organization and PROMIS Cooperative Group. PROMIS v1.1 Pediatric Profile 25. 2013. PROMIS Health Organization and PROMIS Cooperative Group. PROMIS v1.1 Pediatric Profile 25. 2013.
21.
go back to reference Moodie M, Richardson J, Rankin B, Iezzi A, Sinha K. Predicting time trade-off health state valuations of adolescents in four Pacific countries using the assessment of quality-of-life (AQoL-6D) instrument. Value Heal. 2010;13:1014–27.CrossRef Moodie M, Richardson J, Rankin B, Iezzi A, Sinha K. Predicting time trade-off health state valuations of adolescents in four Pacific countries using the assessment of quality-of-life (AQoL-6D) instrument. Value Heal. 2010;13:1014–27.CrossRef
22.
go back to reference Dolan P, Gudex C, Kind P, Williams A. Valuing health states: a comparison of methods. J Health Econ. 1996;15:209–31.CrossRefPubMed Dolan P, Gudex C, Kind P, Williams A. Valuing health states: a comparison of methods. J Health Econ. 1996;15:209–31.CrossRefPubMed
23.
go back to reference Abdi H. The Kendall rank correlation coefficient. In: Salkind N, editor. Encycl Meas Stat. Richardson, TX. Thousand Oaks: Sage Publications; 2007. Abdi H. The Kendall rank correlation coefficient. In: Salkind N, editor. Encycl Meas Stat. Richardson, TX. Thousand Oaks: Sage Publications; 2007.
24.
go back to reference Brunner HI, Maker D, Grundland B, Young NL, Blanchette V, Stain a M, et al. Preference-based measurement of health-related quality of life (HRQL) in children with chronic musculoskeletal disorders (MSKDs). Med Decis Mak. 2003;23:314–22.CrossRef Brunner HI, Maker D, Grundland B, Young NL, Blanchette V, Stain a M, et al. Preference-based measurement of health-related quality of life (HRQL) in children with chronic musculoskeletal disorders (MSKDs). Med Decis Mak. 2003;23:314–22.CrossRef
25.
go back to reference Stevens K, Ratcliffe J. Measuring and valuing health benefits for economic evaluation in adolescence: an assessment of the practicality and validity of the child health utility 9d in the australian adolescent population. Value Heal. 2012;15:1092–9.CrossRef Stevens K, Ratcliffe J. Measuring and valuing health benefits for economic evaluation in adolescence: an assessment of the practicality and validity of the child health utility 9d in the australian adolescent population. Value Heal. 2012;15:1092–9.CrossRef
26.
go back to reference Ratcliffe J, Huynh E, Chen G, Stevens K, Swait J, Brazier J, et al. Valuing the child health utility 9D: using profile case best worst scaling methods to develop a new adolescent specific scoring algorithm. Soc Sci Med. 2016;157:48–59.CrossRefPubMed Ratcliffe J, Huynh E, Chen G, Stevens K, Swait J, Brazier J, et al. Valuing the child health utility 9D: using profile case best worst scaling methods to develop a new adolescent specific scoring algorithm. Soc Sci Med. 2016;157:48–59.CrossRefPubMed
28.
go back to reference Chen G, Ratcliffe J. A review of the development and application of generic multi-attribute utility instruments for Paediatric populations. PharmacoEconomics. 2015;33:1013–28.CrossRefPubMed Chen G, Ratcliffe J. A review of the development and application of generic multi-attribute utility instruments for Paediatric populations. PharmacoEconomics. 2015;33:1013–28.CrossRefPubMed
Metadata
Title
Testing the feasibility of eliciting preferences for health states from adolescents using direct methods
Authors
R. Trafford Crump
Ryan Lau
Elizabeth Cox
Gillian Currie
Julie Panepinto
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue 1/2018
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/s12887-018-1179-7

Other articles of this Issue 1/2018

BMC Pediatrics 1/2018 Go to the issue