Skip to main content
Top
Published in: The Patient - Patient-Centered Outcomes Research 5/2015

01-10-2015 | Original Research Article

Using Best–Worst Scaling to Measure Caregiver Preferences for Managing their Child’s ADHD: A Pilot Study

Authors: Susan dosReis, Xinyi Ng, Emily Frosch, Gloria Reeves, Charles Cunningham, John F. P. Bridges

Published in: The Patient - Patient-Centered Outcomes Research | Issue 5/2015

Login to get access

Abstract

Background

Management of attention-deficit/hyperactivity disorder (ADHD) is a trade-off between caregivers’ concerns about the benefits versus the risks of evidence-based treatment. Few studies have used choice-based methods to assess what treatment attributes matter most to caregivers.

Objective

The aim was to develop and to pilot an instrument to elicit caregivers’ preferences for evidence-based management of their child’s ADHD.

Methods

Mixed methods were used to develop a Best–Worst Scaling (BWS) instrument, and quantitative methods were used to pilot the instrument. Primary caregivers of children with ADHD from two community organizations were recruited for the development (n = 21) and pilot (n = 37) phase. The instrument was a BWS case 2, where 18 management profiles are presented one at a time, with respondents indicating the one best and one worst feature of each profile. Profiles were developed using a main effects orthogonal array. The mean of best-minus-worse scores was estimated, and attribute importance was based on the sum of maximum minus minimum scores for each attribute. Feasibility of eliciting stated preferences was evaluated with t tests and 95 % confidence intervals.

Results

Seven attributes (medication, therapy, school, caregiver training, provider specialty, provider communication, and out-of-pocket costs) with three levels each were identified. All mean scores were significant except for pediatrician management of the child’s ADHD (p = 0.089). Caregiver training had the highest relative importance, followed by medication and provider communication.

Conclusions

The BWS instrument was a relatively simple measure, caregivers completed it independently, and it distinguished the relative importance of different attributes in managing a child’s ADHD.
Appendix
Available only for authorised users
Literature
1.
go back to reference Perou R, Bitsko RH, Blumberg SJ, Pastor P, Ghandour RM, Gfroerer JC, et al. Mental health surveillance among children—United States, 2005–2011. MMWR Surv Summ. 2013;62(Suppl 2):1–35. Perou R, Bitsko RH, Blumberg SJ, Pastor P, Ghandour RM, Gfroerer JC, et al. Mental health surveillance among children—United States, 2005–2011. MMWR Surv Summ. 2013;62(Suppl 2):1–35.
2.
go back to reference Donfrancesco R, Marano A, Calderoni D, Mugnaini D, Thomas F, Di Trani M, et al. Prevalence of severe ADHD: an epidemiological study in the Italian regions of Tuscany and Latium. Epidemiol Psychiatr Sci. 2014;15:1–9.CrossRef Donfrancesco R, Marano A, Calderoni D, Mugnaini D, Thomas F, Di Trani M, et al. Prevalence of severe ADHD: an epidemiological study in the Italian regions of Tuscany and Latium. Epidemiol Psychiatr Sci. 2014;15:1–9.CrossRef
3.
go back to reference Parr JR, Ward A, Inman S. Current practice in the management of attention deficit disorder with hyperactivity (ADHD). Child Care Health Dev. 2003;29(3):215–8.CrossRefPubMed Parr JR, Ward A, Inman S. Current practice in the management of attention deficit disorder with hyperactivity (ADHD). Child Care Health Dev. 2003;29(3):215–8.CrossRefPubMed
4.
go back to reference Olfson M, Gameroff MJ, Marcus SC, Jensen PS. National trends in the treatment of attention deficit hyperactivity disorder. Am J Psychiatry. 2003;160(6):1071–7.CrossRefPubMed Olfson M, Gameroff MJ, Marcus SC, Jensen PS. National trends in the treatment of attention deficit hyperactivity disorder. Am J Psychiatry. 2003;160(6):1071–7.CrossRefPubMed
5.
go back to reference Olfson M, Marcus S, Weissman MM, Jensen PS. National trends in the use of psychotropic medications by children. J Am Acad Child Adolesc Psychiatry. 2002;41(5):514–21.CrossRefPubMed Olfson M, Marcus S, Weissman MM, Jensen PS. National trends in the use of psychotropic medications by children. J Am Acad Child Adolesc Psychiatry. 2002;41(5):514–21.CrossRefPubMed
6.
go back to reference Zito JM, Safer DJ, dosReis S, Gardner JF, Magder L, Soeken K, et al. Psychotropic practice patterns for youth. A 10-year perspective. Arch Pediatr Adolesc Med. 2003;157:17–25.CrossRefPubMed Zito JM, Safer DJ, dosReis S, Gardner JF, Magder L, Soeken K, et al. Psychotropic practice patterns for youth. A 10-year perspective. Arch Pediatr Adolesc Med. 2003;157:17–25.CrossRefPubMed
7.
go back to reference Zito JM, Safer DJ, Riddle MA, Johnson RE, Speedie SM, Fox M. Prevalence variations in psychotropic treatment of children. J Child Adolesc Psychopharmacol. 1998;8(2):99–105.CrossRefPubMed Zito JM, Safer DJ, Riddle MA, Johnson RE, Speedie SM, Fox M. Prevalence variations in psychotropic treatment of children. J Child Adolesc Psychopharmacol. 1998;8(2):99–105.CrossRefPubMed
8.
go back to reference Visser SN, Bitsko RH, Danielson ML, Perou R. Increasing prevalence of parent-reported attention-deficit/hyperactivity disorder among children—United States, 2003 and 2007. MMWR Morb Mortal Wkly Rep. 2010;59(44):1439–43. Visser SN, Bitsko RH, Danielson ML, Perou R. Increasing prevalence of parent-reported attention-deficit/hyperactivity disorder among children—United States, 2003 and 2007. MMWR Morb Mortal Wkly Rep. 2010;59(44):1439–43.
9.
go back to reference American Academy of Child and Adolescent Psychiatry. Practice parameters for the assessment and treatment of children, adolescents, and adults with attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. 1997;36(10 Suppl):85S–121S. American Academy of Child and Adolescent Psychiatry. Practice parameters for the assessment and treatment of children, adolescents, and adults with attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. 1997;36(10 Suppl):85S–121S.
10.
go back to reference American Academy of Child and Adolescent Psychiatry. Practice parameters for the use of stimulant medications in the treatment of children, adolescents, and adults. J Am Acad Child Adolesc Psychiatry. 2002;41(2 Suppl):26S–49S. American Academy of Child and Adolescent Psychiatry. Practice parameters for the use of stimulant medications in the treatment of children, adolescents, and adults. J Am Acad Child Adolesc Psychiatry. 2002;41(2 Suppl):26S–49S.
11.
go back to reference American Academy of Pediatrics. Clinical practice guideline: treatment of the school-aged child with attention-deficit/hyperactivity disorder. Pediatrics. 2001;108(4):1033–44.CrossRef American Academy of Pediatrics. Clinical practice guideline: treatment of the school-aged child with attention-deficit/hyperactivity disorder. Pediatrics. 2001;108(4):1033–44.CrossRef
12.
go back to reference The MTA Cooperative Group. Moderators and mediators of treatment response for children with attention-deficit/hyperactivity disorder. Arch Gen Psychiatry. 1999;56:1088–96.CrossRef The MTA Cooperative Group. Moderators and mediators of treatment response for children with attention-deficit/hyperactivity disorder. Arch Gen Psychiatry. 1999;56:1088–96.CrossRef
13.
go back to reference The MTA Cooperative Group. A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Arch Gen Psychiatry. 1999;56:1073–86.CrossRef The MTA Cooperative Group. A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Arch Gen Psychiatry. 1999;56:1073–86.CrossRef
14.
go back to reference Ruel J, Hickey CP. Are too many children being treated with methylphenidate? Can J Psychiatry. 1992;37(8):570–2.PubMed Ruel J, Hickey CP. Are too many children being treated with methylphenidate? Can J Psychiatry. 1992;37(8):570–2.PubMed
15.
go back to reference Jensen PS, Kettle L, Roper MT, Sloan MT, Dulcan MK, Hoven C, et al. Are stimulants overprescribed? Treatment of ADHD in four U.S. communities. J Am Acad Child Adolesc Psychiatry. 1999;38(7):797–804.CrossRefPubMed Jensen PS, Kettle L, Roper MT, Sloan MT, Dulcan MK, Hoven C, et al. Are stimulants overprescribed? Treatment of ADHD in four U.S. communities. J Am Acad Child Adolesc Psychiatry. 1999;38(7):797–804.CrossRefPubMed
16.
go back to reference Schelleman H, Bilker WB, Strom BL, Kimmel SE, Newcomb C, Guevara JP, et al. Cardiovascular events and death in children exposed and unexposed to ADHD agents. Pediatrics. 2011;127(6):1102–10.PubMedCentralCrossRefPubMed Schelleman H, Bilker WB, Strom BL, Kimmel SE, Newcomb C, Guevara JP, et al. Cardiovascular events and death in children exposed and unexposed to ADHD agents. Pediatrics. 2011;127(6):1102–10.PubMedCentralCrossRefPubMed
17.
go back to reference Winterstein AG. Cardiovascular safety of stimulants in children: findings from recent population-based cohort studies. Curr Psychiatry Rep. 2013;15(8):379.CrossRefPubMed Winterstein AG. Cardiovascular safety of stimulants in children: findings from recent population-based cohort studies. Curr Psychiatry Rep. 2013;15(8):379.CrossRefPubMed
18.
go back to reference Swanson J, Greenhill L, Wigal T, Kollins S, Stehli A, Davies M, et al. Stimulant-related reductions of growth rates in the PATS. J Am Acad Child Adolesc Psychiatry. 2006;45(11):1304–13.CrossRefPubMed Swanson J, Greenhill L, Wigal T, Kollins S, Stehli A, Davies M, et al. Stimulant-related reductions of growth rates in the PATS. J Am Acad Child Adolesc Psychiatry. 2006;45(11):1304–13.CrossRefPubMed
19.
go back to reference Hansen DL, Hansen EH. Caught in a balancing act: parents’ dilemmas regarding their ADHD child’s treatment with stimulant medication. Qual Health Res. 2006;16(9):1267–85.CrossRefPubMed Hansen DL, Hansen EH. Caught in a balancing act: parents’ dilemmas regarding their ADHD child’s treatment with stimulant medication. Qual Health Res. 2006;16(9):1267–85.CrossRefPubMed
20.
go back to reference McLeod JD, Fettes DL, Jensen PS, Pescosolido BA, Martin JK. Public knowledge, beliefs, and treatment preferences concerning attention-deficit hyperactivity disorder. Psychiatr Serv. 2007;58(5):626–31.PubMedCentralCrossRefPubMed McLeod JD, Fettes DL, Jensen PS, Pescosolido BA, Martin JK. Public knowledge, beliefs, and treatment preferences concerning attention-deficit hyperactivity disorder. Psychiatr Serv. 2007;58(5):626–31.PubMedCentralCrossRefPubMed
21.
go back to reference dosReis S, Barksdale CL, Sherman A, Maloney K, Charach A. Stigmatizing experiences of parents of children newly diagnosed with ADHD. Psychiatr Serv. 2010;61(8):811–6.CrossRefPubMed dosReis S, Barksdale CL, Sherman A, Maloney K, Charach A. Stigmatizing experiences of parents of children newly diagnosed with ADHD. Psychiatr Serv. 2010;61(8):811–6.CrossRefPubMed
22.
go back to reference dosReis S, Mychailyszyn MP, Evans-Lacko SE, Beltran A, Riley AW, Myers MA. The meaning of ADHD medication and parents’ initiation and continuity of treatment for their child. J Child Adolesc Psychopharmacol. 2009;19(4):377–83.PubMedCentralCrossRefPubMed dosReis S, Mychailyszyn MP, Evans-Lacko SE, Beltran A, Riley AW, Myers MA. The meaning of ADHD medication and parents’ initiation and continuity of treatment for their child. J Child Adolesc Psychopharmacol. 2009;19(4):377–83.PubMedCentralCrossRefPubMed
23.
go back to reference dosReis S, Mychailyszyn MP, Myers MA, Riley AW. Coming to terms with ADHD: how urban African–American families come to seek care for their children. Psychiatr Serv. 2007;58(5):636–41.CrossRefPubMed dosReis S, Mychailyszyn MP, Myers MA, Riley AW. Coming to terms with ADHD: how urban African–American families come to seek care for their children. Psychiatr Serv. 2007;58(5):636–41.CrossRefPubMed
24.
go back to reference Leslie LK, Plemmons D, Monn AR, Palinkas LA. Investigating ADHD treatment trajectories: listening to families’ stories about medication use. J Dev Behav Pediatr. 2007;28(3):179–88.CrossRefPubMed Leslie LK, Plemmons D, Monn AR, Palinkas LA. Investigating ADHD treatment trajectories: listening to families’ stories about medication use. J Dev Behav Pediatr. 2007;28(3):179–88.CrossRefPubMed
25.
go back to reference Bussing R, Zima BT, Gary FA, Garvan CW. Barriers to detection, help-seeking, and service use for children with ADHD symptoms. J Behav Health Serv Res. 2003;30(2):176–89.CrossRefPubMed Bussing R, Zima BT, Gary FA, Garvan CW. Barriers to detection, help-seeking, and service use for children with ADHD symptoms. J Behav Health Serv Res. 2003;30(2):176–89.CrossRefPubMed
26.
go back to reference dosReis S, Butz A, Lipkin P, Anixt J, Weiner CL, Chernoff R. Attitudes about stimulant medication for attention-deficit/hyperactivity disorder among African–American families in an inner city community. J Behav Health Serv Res. 2006;33(4):423–30.CrossRefPubMed dosReis S, Butz A, Lipkin P, Anixt J, Weiner CL, Chernoff R. Attitudes about stimulant medication for attention-deficit/hyperactivity disorder among African–American families in an inner city community. J Behav Health Serv Res. 2006;33(4):423–30.CrossRefPubMed
27.
go back to reference Charach A, Ickowicz A, Schachar R. Stimulant treatment over five years: adherence, effectiveness, and adverse effects. J Am Acad Child Adolesc Psychiatry. 2004;43(5):559–67.CrossRefPubMed Charach A, Ickowicz A, Schachar R. Stimulant treatment over five years: adherence, effectiveness, and adverse effects. J Am Acad Child Adolesc Psychiatry. 2004;43(5):559–67.CrossRefPubMed
28.
go back to reference Swift JK, Callahan JL. The impact of client treatment preferences on outcome: a meta-analysis. J Clin Psychol. 2009;65(4):368–81.CrossRefPubMed Swift JK, Callahan JL. The impact of client treatment preferences on outcome: a meta-analysis. J Clin Psychol. 2009;65(4):368–81.CrossRefPubMed
29.
go back to reference Bussing R, Koro-Ljungberg ME, Gary F, Mason DM, Garvan CW. Exploring help-seeking for ADHD symptoms: a mixed-methods approach. Harv Rev Psychiatry. 2005;13(2):85–101.CrossRefPubMed Bussing R, Koro-Ljungberg ME, Gary F, Mason DM, Garvan CW. Exploring help-seeking for ADHD symptoms: a mixed-methods approach. Harv Rev Psychiatry. 2005;13(2):85–101.CrossRefPubMed
30.
go back to reference dosReis S, Myers MA. Parental attitudes and involvement in psychopharmacological treatment for ADHD: a conceptual model. Int Rev Psychiatry. 2008;20(2):135–41.CrossRefPubMed dosReis S, Myers MA. Parental attitudes and involvement in psychopharmacological treatment for ADHD: a conceptual model. Int Rev Psychiatry. 2008;20(2):135–41.CrossRefPubMed
31.
32.
go back to reference Muhlbacher A, Rudolph I, Lincke H-J, Nubling M. Preferences for treatment of attention-deficit/hyperactivity disorder (ADHD): a discrete choice experiment. BMC Health Serv Res. 2009;9(1):149.PubMedCentralCrossRefPubMed Muhlbacher A, Rudolph I, Lincke H-J, Nubling M. Preferences for treatment of attention-deficit/hyperactivity disorder (ADHD): a discrete choice experiment. BMC Health Serv Res. 2009;9(1):149.PubMedCentralCrossRefPubMed
33.
go back to reference Muhlbacher AC, Nubling M. Analysis of patients’ preferences: direct assessment and discrete-choice experiment in therapy of adults with attention-deficit hyperactivity disorder. Patient. 2010;3(4):285–94.CrossRefPubMed Muhlbacher AC, Nubling M. Analysis of patients’ preferences: direct assessment and discrete-choice experiment in therapy of adults with attention-deficit hyperactivity disorder. Patient. 2010;3(4):285–94.CrossRefPubMed
34.
go back to reference Secnik K, Matza LS, Cottrell S, Edgell E, Tilden D, Mannix S. Health state utilities for childhood attention-deficit/hyperactivity disorder based on parent preferences in the United Kingdom. Med Decis Making. 2005;25(1):56–70.CrossRefPubMed Secnik K, Matza LS, Cottrell S, Edgell E, Tilden D, Mannix S. Health state utilities for childhood attention-deficit/hyperactivity disorder based on parent preferences in the United Kingdom. Med Decis Making. 2005;25(1):56–70.CrossRefPubMed
35.
go back to reference Waschbusch DA, Cunningham CE, Pelham WE, Rimas HL, Greiner AR, Gnagy EM, et al. A discrete choice conjoint experiment to evaluate parent preferences for treatment of young, medication naive children with ADHD. J Clin Child Adolesc Psychol. 2011;40(4):546–61.PubMedCentralCrossRefPubMed Waschbusch DA, Cunningham CE, Pelham WE, Rimas HL, Greiner AR, Gnagy EM, et al. A discrete choice conjoint experiment to evaluate parent preferences for treatment of young, medication naive children with ADHD. J Clin Child Adolesc Psychol. 2011;40(4):546–61.PubMedCentralCrossRefPubMed
36.
go back to reference Mullins CD, Abdulhalim AM, Lavallee DC. Continuous patient engagement in comparative effectiveness research. J Am Med Assoc. 2012;307(15):1587–8.CrossRef Mullins CD, Abdulhalim AM, Lavallee DC. Continuous patient engagement in comparative effectiveness research. J Am Med Assoc. 2012;307(15):1587–8.CrossRef
37.
go back to reference Bridges JF, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, et al. Conjoint analysis applications in health—a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. Value Health. 2011;14(4):403–13.CrossRefPubMed Bridges JF, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, et al. Conjoint analysis applications in health—a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. Value Health. 2011;14(4):403–13.CrossRefPubMed
38.
go back to reference Coast J, Al-Janabi H, Sutton EJ, Horrocks SA, Vosper AJ, Swancutt DR, et al. Using qualitative methods for attribute development for discrete choice experiments: issues and recommendations. Health Econ. 2012;21(6):730–41.CrossRefPubMed Coast J, Al-Janabi H, Sutton EJ, Horrocks SA, Vosper AJ, Swancutt DR, et al. Using qualitative methods for attribute development for discrete choice experiments: issues and recommendations. Health Econ. 2012;21(6):730–41.CrossRefPubMed
39.
go back to reference Flynn TN. Valuing citizen and patient preferences in health: recent developments in three types of best–worst scaling. Expert Rev Pharmacoecon Outcomes Res. 2010;10(3):259–67.CrossRefPubMed Flynn TN. Valuing citizen and patient preferences in health: recent developments in three types of best–worst scaling. Expert Rev Pharmacoecon Outcomes Res. 2010;10(3):259–67.CrossRefPubMed
41.
go back to reference Louviere JJ, Flynn TN. Using best–worst scaling choice experiments to measure public perceptions and preferences for healthcare reform in Australia. Patient. 2010;3(4):275–83.CrossRefPubMed Louviere JJ, Flynn TN. Using best–worst scaling choice experiments to measure public perceptions and preferences for healthcare reform in Australia. Patient. 2010;3(4):275–83.CrossRefPubMed
42.
go back to reference Tsai P-W, Gilmour SG, Mead R. Some new three-leel orthogonal main effects plans robust to model uncertainty. Stat Sin. 2004;14:1075–84. Tsai P-W, Gilmour SG, Mead R. Some new three-leel orthogonal main effects plans robust to model uncertainty. Stat Sin. 2004;14:1075–84.
43.
go back to reference Gallego G, Bridges JF, Flynn T, Blauvelt BM, Niessen LW. Using best–worst scaling in horizon scanning for hepatocellular carcinoma technologies. Int J Technol Assess Health Care. 2012;28(3):339–46.CrossRefPubMed Gallego G, Bridges JF, Flynn T, Blauvelt BM, Niessen LW. Using best–worst scaling in horizon scanning for hepatocellular carcinoma technologies. Int J Technol Assess Health Care. 2012;28(3):339–46.CrossRefPubMed
44.
go back to reference Finn A, Louviere JJ. Determining the appropriate response to evidence of public concern: the case of food safety. J Public Pol Health. 1992;11(1):12–25. Finn A, Louviere JJ. Determining the appropriate response to evidence of public concern: the case of food safety. J Public Pol Health. 1992;11(1):12–25.
45.
go back to reference Bussing R, Schoenberg NE, Perwien AR. Knowledge and information about ADHD: evidence of cultural differences among African–American and white parents. Soc Sci Med. 1998;46(7):919–28.CrossRefPubMed Bussing R, Schoenberg NE, Perwien AR. Knowledge and information about ADHD: evidence of cultural differences among African–American and white parents. Soc Sci Med. 1998;46(7):919–28.CrossRefPubMed
46.
go back to reference dosReis S, Zito JM, Safer DJ, Soeken KL, Mitchell JW, Ellwood LC. Parental perceptions and satisfaction with stimulant medication for attention-deficit/hyperactivity disorder. J Dev Behav Pediatr. 2003;24(3):155–62.CrossRefPubMed dosReis S, Zito JM, Safer DJ, Soeken KL, Mitchell JW, Ellwood LC. Parental perceptions and satisfaction with stimulant medication for attention-deficit/hyperactivity disorder. J Dev Behav Pediatr. 2003;24(3):155–62.CrossRefPubMed
47.
go back to reference Chronis AM, Chacko A, Fabiano GA, Wymbs BT, Pelham WE Jr. Enhancements to the behavioral parent training paradigm for families of children with ADHD: review and future directions. Clin Child Fam Psychol Rev. 2004;7(1):1–27.CrossRefPubMed Chronis AM, Chacko A, Fabiano GA, Wymbs BT, Pelham WE Jr. Enhancements to the behavioral parent training paradigm for families of children with ADHD: review and future directions. Clin Child Fam Psychol Rev. 2004;7(1):1–27.CrossRefPubMed
Metadata
Title
Using Best–Worst Scaling to Measure Caregiver Preferences for Managing their Child’s ADHD: A Pilot Study
Authors
Susan dosReis
Xinyi Ng
Emily Frosch
Gloria Reeves
Charles Cunningham
John F. P. Bridges
Publication date
01-10-2015
Publisher
Springer International Publishing
Published in
The Patient - Patient-Centered Outcomes Research / Issue 5/2015
Print ISSN: 1178-1653
Electronic ISSN: 1178-1661
DOI
https://doi.org/10.1007/s40271-014-0098-4

Other articles of this Issue 5/2015

The Patient - Patient-Centered Outcomes Research 5/2015 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.