Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
Health and Quality of Life Outcomes
Published in: Health and Quality of Life Outcomes 1/2006

Open Access 01-12-2006 | Research

A pilot Internet "Value of Health" Panel: recruitment, participation and compliance

Authors: Ken Stein, Matthew Dyer, Tania Crabb, Ruairidh Milne, Alison Round, Julie Ratcliffe, John Brazier

Published in: Health and Quality of Life Outcomes | Issue 1/2006

Login to get access

Abstract

Objectives

To pilot using a panel of members of the public to provide preference data via the Internet

Methods

A stratified random sample of members of the general public was recruited and familiarised with the standard gamble procedure using an Internet based tool. Health states were perdiodically presented in "sets" corresponding to different conditions, during the study. The following were described: Recruitment (proportion of people approached who were trained); Participation (a) the proportion of people trained who provided any preferences and (b) the proportion of panel members who contributed to each "set" of values; and Compliance (the proportion, per participant, of preference tasks which were completed). The influence of covariates on these outcomes was investigated using univariate and multivariate analyses.

Results

A panel of 112 people was recruited. 23% of those approached (n = 5,320) responded to the invitation, and 24% of respondents (n = 1,215) were willing to participate (net = 5.5%). However, eventual recruitment rates, following training, were low (2.1% of those approached). Recruitment from areas of high socioeconomic deprivation and among ethnic minority communities was low. Eighteen sets of health state descriptions were considered over 14 months. 74% of panel members carried out at least one valuation task. People from areas of higher socioeconomic deprivation and unmarried people were less likely to participate. An average of 41% of panel members expressed preferences on each set of descriptions. Compliance ranged from 3% to 100%.

Conclusion

It is feasible to establish a panel of members of the general public to express preferences on a wide range of health state descriptions using the Internet, although differential recruitment and attrition are important challenges. Particular attention to recruitment and retention in areas of high socioeconomic deprivation and among ethnic minority communities is necessary. Nevertheless, the panel approach to preference measurement using the Internet offers the potential to provide specific utility data in a responsive manner for use in economic evaluations and to address some of the outstanding methodological uncertainties in this field.
Appendix
Available only for authorised users
Literature
1.
Hutton J, Brown R: Use of economic evaluation in decision-making: What needs to change? Value Health 2002, 5: 65–66. 10.1046/j.1524-4733.2002.52115.xPubMedCrossRef
2.
Neumann PJ: Why don't Americans use cost-effectiveness analysis? American Journal of Managed Care 2005, 10: 308–312.
3.
Sonnad S, Greenberg D, Rosen A, Neumann P: Diffusion of published cost-utility analyses in the field of health policy and practice. International Journal of Technology Assessment in Health Care 2005, 21: 399–402.PubMedCrossRef
4.
Glennie J, Torrance GW, Baladi J, Berka C, Hubbard E, Menon D, Otten N, Riviera M: The revised Canadian Guidelines for the Economic Evaluation of Pharmaceuticals. Pharmacoeconomics 1999, 15: 459–468. 10.2165/00019053-199915050-00004PubMedCrossRef
5.
Weinstein MC, Siegel JE, Gold MR, Kamlet MS, Russell LB: recommendations of the panel on cost-effectiveness in health and medicine consensus statement. JAMA 1996, 276: 1253–1258. 10.1001/jama.276.15.1253PubMedCrossRef
6.
National Institute for Clinical Excellence: Guide to the Methods of Technology Appraisal. London, National Institute for Clinical Excellence; 2003.
7.
8.
Brazier J, Akehurst R, Brennan A, Dolan P, Claxton K, McCabe C, O'Hagan T, Sculpher M, Tsuchyia A: Should patients have a greater role in valuing health states: whose well-being is it anyway? [04/3]. Sheffield, School of Health and Related Research, University of Sheffield. Discussion Paper Series; 2004.
9.
Torrance G, Feeny D, Furlong W, Barr R, Zhang Y, Wang Q: Multiattribute utility functions for a comprehensive health status classification. Medical Care 1996, 34: 702–722. 10.1097/00005650-199607000-00004PubMedCrossRef
10.
Gafni A: Willingness to pay as a measure of benefits: relevant questions in the context of public decision making about health care programmes. Medical Care 1991, 29: 1246–1252. 10.1097/00005650-199112000-00007PubMedCrossRef
11.
De Wit GA, Busschbach JJ, De Charro FT: Sensitivity and perspective in the valuation of health status: whose values count? Health Econ 2000, 9: 109–126. 10.1002/(SICI)1099-1050(200003)9:2<109::AID-HEC503>3.0.CO;2-LPubMedCrossRef
12.
Buckingham K: A note on HYE (healthy years equivalent). Health Economics 1993, 12: 301–309. 10.1016/0167-6296(93)90013-5CrossRef
13.
Ubel P, Richardson J, Menzel P: Societal value, the person trade-off, and the dilemma of whose values to measure for cost-effectiveness analysis. Health Economics 2000, 9: 127–136. 10.1002/(SICI)1099-1050(200003)9:2<127::AID-HEC500>3.0.CO;2-YPubMedCrossRef
14.
Furlong W, Oldridge N, Perkins A, Feeny D, Torrance GW: Community or Patient Preferences for Cost-Utility Analyses: Does it Matter? International Society for Pharmacoeconomics, ISPOR Conference, Arlington, Virginia 2003.
15.
Stein K, Fry A, Round A, Milne R, Brazier J: What value health? A review of health state values used in early technology assessments for NICE. Applied Health Economics and Policy 2006.
16.
Dolan P: The measurement of health related quality of life for use in resource allocation in health care. In Handbook of Health Economics. Edited by: Culyer A, Newhouse J. London: Elsevier Science; 2002.
17.
Brennan P, Strombom I: Improving health care by understanding patient preferences. Journal of the American Medical Informatics Association 1998, 5: 257–262.PubMedCentralPubMedCrossRef
18.
Sumner W, Nease R, Littenberg B: U-titer: a utility assessment tool. Proceedings of the Annual Symposium on Computer Application in Medical Care 1991, 701–705.
19.
Sonnenberg FA: UMaker. New Jersey, Clinical Informatics Research Group, University of Medicine and Dentistry; 1993.
20.
Gonzalez B, Eckman G, et al.: Gambler: a computer workstation for patient utility assessment. Medical Decision Making 1992, 12: 350.
21.
Lenert L, Michelson D, Flowers C, Bergen M: IMPACT: an object-orientated graphical environment for construction of multimedia patient interviewing software. Proceedings of the Annual Symposium on Computer Application in Medical Care 1995, 319–323.
22.
Lenert LA, Sturley A, Watson ME: iMPACT3: Internet-Based Development and Administration of Utility Elicitation Protocols. Med Decis Making 2002, 22: 464–474. 10.1177/0272989X02238296PubMedCrossRef
23.
McFarlane P, Bayoumi A, Pierratos A, Redelmeier D: The quality of life and cost utility of home nocturnal and conventional in-center haemodialysis. Kidney International 2003, 64: 1004–1011. 10.1046/j.1523-1755.2003.00157.xPubMedCrossRef
24.
Goldstein MK, Clarke AE, Michelson D, Garber AM, Bergen MR, Lenert LA: Developing and Testing a Multimedia Presentation of a Health-state Description. Med Decis Making 1994, 14: 336–344.PubMedCrossRef
25.
Damschroder L, Zikmund-Fisher B, Kulpa J, Ubel P: Considering adaptation in preference elicitations. Society for Medical Decision Making Annual Conference; San Francisco 2005.
26.
Damschroder L, Muroff J, Smith D, Ubel P: A reversal in the public/patient discrepancy: utility ratings for pain from pain patients are lower than from non-patients. Society for Medical Decision Making Annual Conference; San Francisco 2005.
27.
Damschroder L, Ubel P, Zikmund-Fisher B, Kim S, Johri M: A randomized trial of a web-based deliberation exercise: improving the quality of healthcare allocation preference surveys. Society for Medical Decision Making Annual Conference; San Francisco 2005.
28.
Baron J, Ubel P: Types of inconsistency in health-state utility judgements. Organizational Behaviour and Human Decision Processes 2002, 89: 1100–1118. 10.1016/S0749-5978(02)00019-5CrossRef
29.
Lenert LA, Goldstein MK, Bergen MR, Garber AM: The Effects of the Content of Health State Descriptions on the Between-Subject Variability in Preferences. California, USA, Stanford University; 2005:1–21.
30.
Lenert LA, Ziegler J, Lee T, Unfred C, Mahmoud R: The Risks of Multimedia Methods: Effects of Actor's Race and Gender on Preferences for Health States. J of the American Informatics Assn 2000, 7: 177–185.CrossRef
31.
Marquet RL, Bartelds AI, van Noort SP, Koppeschaar CE, Paget J, Schellevis FG, van der ZJ: Internet-based monitoring of influenza-like illness (ILI) in the general population of the Netherlands during the 2003–2004 influenza season. BMC Public Health 2006, 6: 242. 10.1186/1471-2458-6-242PubMedCentralPubMedCrossRef
32.
Hubbard PA, Broome ME, Antia LA: Pain, coping, and disability in adolescents and young adults with cystic fibrosis: a Web-based study. Pediatr Nurs 2005, 31: 82–86.PubMed
33.
Bowen A, Williams M, Horvath K: Using the internet to recruit rural MSM for HIV risk assessment: sampling issues. AIDS Behav 2004, 8: 311–319. 10.1023/B:AIBE.0000044078.43476.1fPubMedCentralPubMedCrossRef
34.
Fernandez MI, Varga LM, Perrino T, Collazo JB, Subiaul F, Rehbein A, Torres H, Castro M, Bowen GS: The Internet as recruitment tool for HIV studies: viable strategy for reaching at-risk Hispanic MSM in Miami? AIDS Care 2004, 16: 953–963. 10.1080/09540120412331292480PubMedCrossRef
35.
Clarke G, Reid E, Eubanks D, O'Connor E, DeBar LL, Kelleher C, Lynch F, Nunley S: Overcoming depression on the Internet (ODIN): a randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res 2002, 4: E14. 10.2196/jmir.4.3.e14PubMedCentralPubMedCrossRef
36.
Formica M, Kabbara K, Clark R, McAlindon T: Can clinical trials requiring frequent participant contact be conducted over the Internet? Results from an online randomized controlled trial evaluating a topical ointment for herpes labialis. J Med Internet Res 2004, 6: e6. 10.2196/jmir.6.1.e6PubMedCentralPubMedCrossRef
37.
Rhodes SD, Bowie DA, Hergenrather KC: Collecting behavioural data using the world wide web: considerations for researchers. J Epidemiol Community Health 2003, 57: 68–73. 10.1136/jech.57.1.68PubMedCentralPubMedCrossRef
38.
39.
Formica M, Kabbara K, Clark R, McAlindon T: Can clinical trials requiring frequent participant contact be conducted over the Internet? Results from an online randomized controlled trial evaluating a topical ointment for herpes labialis. J Med Internet Res 2004, 6: e6. 10.2196/jmir.6.1.e6PubMedCentralPubMedCrossRef
40.
Clarke G, Reid E, Eubanks D, O'Connor E, DeBar LL, Kelleher C, Lynch F, Nunley S: Overcoming depression on the Internet (ODIN): a randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res 2002, 4: E14. 10.2196/jmir.4.3.e14PubMedCentralPubMedCrossRef
41.
Scholle SH, Peele PB, Kelleher KJ, Frank E, Jansen-McWilliams L, Kupfer D: Effect of different recruitment sources on the composition of a bipolar disorder case registry. Soc Psychiatry Psychiatr Epidemiol 2000, 35: 220–227. 10.1007/s001270050231PubMedCrossRef
42.
Etter JF, Perneger TV: A comparison of cigarette smokers recruited through the Internet or by mail. Int J Epidemiol 2001, 30: 521–525. 10.1093/ije/30.3.521PubMedCrossRef
43.
Im EO, Chee W: Methodological issues in the recruitment of ethnic minority subjects to research via the Internet: a discussion paper. Int J Nurs Stud 2005, 42: 923–929. 10.1016/j.ijnurstu.2005.01.002PubMedCrossRef
44.
Ross MW, Mansson SA, Daneback K, Cooper A, Tikkanen R: Biases in internet sexual health samples: comparison of an internet sexuality survey and a national sexual health survey in Sweden. Soc Sci Med 2005, 61: 245–252. 10.1016/j.socscimed.2005.01.019PubMedCrossRef
45.
46.
Schunemann H, Stahl H, Austin P, Akl E, Armstrong D, Guyatt G: A comparison of narrative and table formats for presenting hypothetical health states to patients with gastrointestinal or pulmonary disease. Medical Decision Making 2004, 24: 53–60. 10.1177/0272989X03261566PubMedCrossRef
47.
Dolan P, Gudex C: Time Preference, Duration and Health State Valuations. Health Economics 1995, 4: 289–299.PubMedCrossRef
48.
von Neumann J, Morganstern O: THeory of Games and Economic Behaviour. 2nd edition. Princeton: Princeton University Press; 1947.
49.
Lenert LA, Cher DJ, Goldstein MK, Bergen MR, Garber A: The Effect of Search Procedures on Utility Elicitations. Med Decis Making 1998, 18: 76–83.PubMedCrossRef
50.
Scottish Index of Multiple Deprivation: Summary Technical Report. Edinburgh, Scottish Executive 2004.
51.
Noble M, Wright G, Dibben C, Smith GAN, McLennan D, Anttila C, Barnes H, Mokhtar C, Noble S, Avenell D, Gardner J, Covizzi I, Lloyd M: Indices of Deprivation 2004: Report to the Office of the Deputy Prime Minister. London, Neighbourhood Renewal Unit; 2004.
52.
Reips UD: Standards for Internet-based experimenting. Exp Psychol 2002, 49: 243–256. 10.1026//1618-3169.49.4.243PubMedCrossRef
53.
Bartlett C, Doyal L, Ebrahim S, DAvey P, Bachmann M, Egger M, Dieppe P: The causes and effects of socio-demographic exclusions from clinical trials. Health Technology Assessment 2005., 9:
54.
Dolan P, Roberts J: To what extent can we explain time trade-off values from other information about respondents? Soc Sci Med 2002, 54: 919–929. 10.1016/S0277-9536(01)00066-1PubMedCrossRef
55.
Dolan P: Effect of age on health state valuations. J Health Serv Res Policy 2000, 5: 17–21.PubMed
56.
Ashby J, Hanlon M, Buxton MJ: The time trade-off technique: how do the valuations of breast cancer patients compare to those of other groups? Quality of Life Research 1994, 3: 257–265. 10.1007/BF00434899PubMedCrossRef
57.
Badia X, Roset M, Herdman M, Kind P: A comparison of United Kingdom and Spanish general population time trade-off values for EQ-5D health states. Medical Decision Making 2001, 21: 7–16.PubMedCrossRef
58.
Sims T, Garber A, Goldstein M: Does education really matter? Examining the role of education in health preferences among older adults. Society for Medical Decision Making, Annual Meeting; San Francisco 2005.
59.
Cykert S, Joines JD, Kissling G, Hansen CJ: Racial differences in patients' perceptions of debilitated health states. J Gen Intern Med 1999, 14: 217–222. 10.1046/j.1525-1497.1999.00320.xPubMedCentralPubMedCrossRef
60.
Dolan P: The Effect of Experience of Illness on Health State Valuations. J Clin Epidemiol 1996, 49: 551–564. 10.1016/0895-4356(95)00532-3PubMedCrossRef
61.
King JT, Tsevat J, Roberts MS: Positive Association between Current Health and Health Values for Hypothetical Disease States. Medical Decision Making 2004, 24: 367–378. 10.1177/0272989X04267692PubMedCrossRef
62.
Lenert L, Treadwell JR, Schwartz C: Associations Between Health Status and Utilities Implications for Policy – Impact of Illness. Med Care 1999, 37: 479–489. 10.1097/00005650-199905000-00007PubMedCrossRef
63.
Rosen A, Tsai J, DOwns S: Variations in risk attitude across race, gender and education. Medical Decision Making 2003, 23: 511–517. 10.1177/0272989X03258431PubMedCrossRef
64.
Woloshin S, Schwartz L, Moncur M, Gabriel S, Tosteson A: Assessing values for health: Numeracy matters. Med Decis Making 2001, 21: 382–390. 10.1177/02729890122062686PubMedCrossRef
65.
Gerson L, Ullah N, Hastie T, Triadafilopoulos G, Goldstein M: Patient derived health state utilities for gastroesophageal reflux disease. American Journal of Gastroenterology 2005, 100: 524–533. 10.1111/j.1572-0241.2005.40588.xPubMedCrossRef
66.
Munakata J, Woolcott J, Anis A, Sculpher M, Yu W, Sanders G, et al.: Design of a prospective economic evaluation for a tri-national clinical trial in HIV patients (OPTIMA). Society for Medical Decision Making Annual Conference; San Francisco 2005.
67.
Tosteson A, Kneeland T, Nease R, Sumner W: Automated Current Health Time-Trade-Off Assessments in Women's Health. Value in Health 2002, 5: 98–105. 10.1046/j.1524-4733.2002.52102.xPubMedCrossRef
68.
69.
Lenert LA, Sturley AE: Acceptability of Computerized Visual Analog Scale, Time Trade-off and Standard Gamble Rating Methods in Patients and the Public. AMI Association Proceedings 2001.
70.
Lenert L, Sturley A, Rupnow M: Toward improved methods for measurement of utility: automated repair of errors in elicitation. Medical Decision Making 2003, 23: 67–75. 10.1177/0272989X02239649PubMedCrossRef
71.
Damschroder L, Baron J, Hershey J, Asch D, Jepson C, Ubel P: The validity of person tradeoff measurements: randomized trial of computer elicitation versus face-to-face interview. Medical Decision Making 2004, 24: 170–180. 10.1177/0272989X04263160PubMedCrossRef
72.
Lenert L: Web-based Assessment of Patients' Preferences. California, USA, University of California, San Diego; 2006.
73.
Lenert L: Validity and interpretation of preference-based measures of quality of life. 2006.
74.
Stein K, Ratcliffe J, Milne R, Round A, Brazier J: Construct validity of utility data obtained from an internet panel of members of the public. Society for Medical Decision Making Annual Meeting Annual Meeting; Boston 2006.
75.
76.
77.
Baker K, Curtice J, Sparrow N: Internet Poll Trial: Research Report. London, ICM Research; 2003.
Metadata
Title
A pilot Internet "Value of Health" Panel: recruitment, participation and compliance
Authors
Ken Stein
Matthew Dyer
Tania Crabb
Ruairidh Milne
Alison Round
Julie Ratcliffe
John Brazier
Publication date
01-12-2006
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2006
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-4-90

Other articles of this Issue 1/2006

Health and Quality of Life Outcomes 1/2006 Go to the issue

Research

A promising method for identifying cross-cultural differences in patient perspective: the use of Internet-based focus groups for content validation of new Patient Reported Outcome assessments

Research

Cost-utility of routine cataract surgery

Research

Factors associated with "Ikigai" among members of a public temporary employment agency for seniors (Silver Human Resources Centre) in Japan; gender differences

Research

Physical activity is related to quality of life in older adults

Research

Misinterpretation with norm-based scoring of health status in adults with type 1 diabetes

Research

Negative impact of chronic obstructive pulmonary disease on the health-related quality of life of patients. Results of the EPIDEPOC study