Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Research article

Is expert opinion reliable when estimating transition probabilities? The case of HCV-related cirrhosis in Egypt

Authors: Anthony Cousien, Dorothée Obach, Sylvie Deuffic-Burban, Aya Mostafa, Gamal Esmat, Valérie Canva, Mohamed El Kassas, Mohammad El-Sayed, Wagida A Anwar, Arnaud Fontanet, Mostafa K Mohamed, Yazdan Yazdanpanah

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

Data on HCV-related cirrhosis progression are scarce in developing countries in general, and in Egypt in particular. The objective of this study was to estimate the probability of death and transition between different health stages of HCV (compensated cirrhosis, decompensated cirrhosis and hepatocellular carcinoma) for an Egyptian population of patients with HCV-related cirrhosis.

Methods

We used the “elicitation of expert opinions” method to obtain collective knowledge from a panel of 23 Egyptian experts (among whom 17 were hepatologists or gastroenterologists and 2 were infectiologists). The questionnaire was based on virtual medical cases and asked the experts to assess probability of death or probability of various cirrhosis complications. The design was a Delphi study: we attempted to obtain a consensus between experts via a series of questionnaires interspersed with group response feedback.

Results

We found substantial disparity between experts’ answers, and no consensus was reached at the end of the process. Moreover, we obtained high death probability and high risk of hepatocellular carcinoma. The annual transition probability to death was estimated at between 10.1% and 61.5% and the annual probability of occurrence of hepatocellular carcinoma was estimated at between 16.8% and 58.9% (depending on age, gender, time spent in cirrhosis and cirrhosis severity).

Conclusions

Our results show that eliciting expert opinions is not suited for determining the natural history of diseases due to practitioners’ difficulties in evaluating quantities. Cognitive bias occurring during this type of study might explain our results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Linstone HA, Turoff M: The Delphi method: techniques and applications. 1975, Reading, Mass: Addison-Wesley Linstone HA, Turoff M: The Delphi method: techniques and applications. 1975, Reading, Mass: Addison-Wesley
2.
go back to reference Dalkey NC, Helmer-Hirschberg O: An experimental application of the Delphi method to the use of experts. 1962, Rand Corp: Santa Monica, Calif Dalkey NC, Helmer-Hirschberg O: An experimental application of the Delphi method to the use of experts. 1962, Rand Corp: Santa Monica, Calif
3.
go back to reference Deville W, Greacen T, Bogic M, Dauvrin M, Dias S, Gaddini A, Jensen NK, Karamanidou C, Kluge U, Mertaniemi R, I Riera RP, Sarvary A, Soares JJ, Stankunas M, Strassmayr C, Welbel M, Priebe S: Health care for immigrants in Europe: is there still consensus among country experts about principles of good practice? A Delphi study. BMC Public Health. 2011, 11: 699-10.1186/1471-2458-11-699.CrossRefPubMedPubMedCentral Deville W, Greacen T, Bogic M, Dauvrin M, Dias S, Gaddini A, Jensen NK, Karamanidou C, Kluge U, Mertaniemi R, I Riera RP, Sarvary A, Soares JJ, Stankunas M, Strassmayr C, Welbel M, Priebe S: Health care for immigrants in Europe: is there still consensus among country experts about principles of good practice? A Delphi study. BMC Public Health. 2011, 11: 699-10.1186/1471-2458-11-699.CrossRefPubMedPubMedCentral
4.
go back to reference Hermanides HS, van Vught LA, Voigt R, Muskiet FD, Durand A, van Osch G, Koolman-Wever S, Gerstenbluth I, Smit C, Duits AJ: Developing quality indicators for the care of HIV-infected pregnant women in the Dutch Caribbean. AIDS Res Ther. 2011, 8 (1): 32-10.1186/1742-6405-8-32.CrossRefPubMedPubMedCentral Hermanides HS, van Vught LA, Voigt R, Muskiet FD, Durand A, van Osch G, Koolman-Wever S, Gerstenbluth I, Smit C, Duits AJ: Developing quality indicators for the care of HIV-infected pregnant women in the Dutch Caribbean. AIDS Res Ther. 2011, 8 (1): 32-10.1186/1742-6405-8-32.CrossRefPubMedPubMedCentral
5.
go back to reference Lubell Y, Staedke SG, Greenwood BM, Kamya MR, Molyneux M, Newton PN, Reyburn H, Snow RW, D'alessandro U, English M, Day N, Kremsner P, Dondorp A, Mbacham W, Dorsey G, Owusu-Agyei S, Maitland K, Krishna S, Newton C, Pasvol G, Taylor T, Von Seidlein L, White NJ, Binka F, Mills A, Whitty CJ: Likely health outcomes for untreated acute febrile illness in the tropics in decision and economic models; a Delphi survey. PLoS One. 2011, 6 (2): e17439-10.1371/journal.pone.0017439.CrossRefPubMedPubMedCentral Lubell Y, Staedke SG, Greenwood BM, Kamya MR, Molyneux M, Newton PN, Reyburn H, Snow RW, D'alessandro U, English M, Day N, Kremsner P, Dondorp A, Mbacham W, Dorsey G, Owusu-Agyei S, Maitland K, Krishna S, Newton C, Pasvol G, Taylor T, Von Seidlein L, White NJ, Binka F, Mills A, Whitty CJ: Likely health outcomes for untreated acute febrile illness in the tropics in decision and economic models; a Delphi survey. PLoS One. 2011, 6 (2): e17439-10.1371/journal.pone.0017439.CrossRefPubMedPubMedCentral
6.
go back to reference Schultz EM, Silvestri GA, Gould MK: Variation in experts’ beliefs about lung cancer growth, progression, and prognosis. J Thorac Oncol. 2008, 3 (4): 422-426. 10.1097/JTO.0b013e318167146b.CrossRefPubMedPubMedCentral Schultz EM, Silvestri GA, Gould MK: Variation in experts’ beliefs about lung cancer growth, progression, and prognosis. J Thorac Oncol. 2008, 3 (4): 422-426. 10.1097/JTO.0b013e318167146b.CrossRefPubMedPubMedCentral
7.
go back to reference Dalkey NC: The Delphi method: an experimental study of group opinion. 1969, Rand Corp: Santa Monica, Calif Dalkey NC: The Delphi method: an experimental study of group opinion. 1969, Rand Corp: Santa Monica, Calif
8.
go back to reference D’Amico G, Garcia-Tsao G, Pagliaro L: Natural history and prognostic indicators of survival in cirrhosis: a systematic review of 118 studies. J Hepatol. 2006, 44 (1): 217-231. 10.1016/j.jhep.2005.10.013.CrossRefPubMed D’Amico G, Garcia-Tsao G, Pagliaro L: Natural history and prognostic indicators of survival in cirrhosis: a systematic review of 118 studies. J Hepatol. 2006, 44 (1): 217-231. 10.1016/j.jhep.2005.10.013.CrossRefPubMed
9.
go back to reference Davis GL, Alter MJ, El-Serag H, Poynard T, Jennings LW, Davis GL, Alter MJ, El-Serag H, Poynard T, Jennings LW: Aging of hepatitis C virus (HCV)-infected persons in the United States: a multiple cohort model of HCV prevalence and disease progression. Gastroenterology. 2010, 138 (2): 513-521. 10.1053/j.gastro.2009.09.067. 521 e511-516CrossRefPubMed Davis GL, Alter MJ, El-Serag H, Poynard T, Jennings LW, Davis GL, Alter MJ, El-Serag H, Poynard T, Jennings LW: Aging of hepatitis C virus (HCV)-infected persons in the United States: a multiple cohort model of HCV prevalence and disease progression. Gastroenterology. 2010, 138 (2): 513-521. 10.1053/j.gastro.2009.09.067. 521 e511-516CrossRefPubMed
10.
go back to reference Sievert W, Altraif I, Razavi HA, Abdo A, Ahmed EA, Alomair A, Amarapurkar D, Chen CH, Dou X, El Khayat H, Elshazly M, Esmat G, Guan R, Han KH, Koike K, Largen A, Mccaughan G, Mogawer S, Monis A, Nawaz A, Piratvisuth T, Sanai FM, Sharara AI, Sibbel S, Sood A, Suh DJ, Wallace C, Young K, Negro F: A systematic review of hepatitis C virus epidemiology in Asia, Australia and Egypt. Liver Int. 2011, 31 (Suppl 2): 61-80.CrossRefPubMed Sievert W, Altraif I, Razavi HA, Abdo A, Ahmed EA, Alomair A, Amarapurkar D, Chen CH, Dou X, El Khayat H, Elshazly M, Esmat G, Guan R, Han KH, Koike K, Largen A, Mccaughan G, Mogawer S, Monis A, Nawaz A, Piratvisuth T, Sanai FM, Sharara AI, Sibbel S, Sood A, Suh DJ, Wallace C, Young K, Negro F: A systematic review of hepatitis C virus epidemiology in Asia, Australia and Egypt. Liver Int. 2011, 31 (Suppl 2): 61-80.CrossRefPubMed
11.
go back to reference Cornberg M, Razavi HA, Alberti A, Bernasconi E, Buti M, Cooper C, Dalgard O, Dillion JF, Flisiak R, Forns X, Frankova S, Goldis A, Goulis I, Halota W, Hunyady B, Lagging M, Largen A, Makara M, Manolakopoulos S, Marcellin P, Marinho RT, Pol S, Poynard T, Puoti M, Sagalova O, Sibbel S, Simon K, Wallace C, Young K, Yurdaydin C, Zuckerman E, Negro F, Zeuzem S: A systematic review of hepatitis C virus epidemiology in Europe, Canada and Israel. Liver Int. 2011, 31 (Suppl 2): 30-60.CrossRefPubMed Cornberg M, Razavi HA, Alberti A, Bernasconi E, Buti M, Cooper C, Dalgard O, Dillion JF, Flisiak R, Forns X, Frankova S, Goldis A, Goulis I, Halota W, Hunyady B, Lagging M, Largen A, Makara M, Manolakopoulos S, Marcellin P, Marinho RT, Pol S, Poynard T, Puoti M, Sagalova O, Sibbel S, Simon K, Wallace C, Young K, Yurdaydin C, Zuckerman E, Negro F, Zeuzem S: A systematic review of hepatitis C virus epidemiology in Europe, Canada and Israel. Liver Int. 2011, 31 (Suppl 2): 30-60.CrossRefPubMed
12.
go back to reference Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86 (2): 420-428.CrossRefPubMed Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86 (2): 420-428.CrossRefPubMed
13.
go back to reference D’Amico G, Pasta L, Madonia S, Tarantino I, Mancuso A, Malizia G, Giannuoli G, Pagliaro L: The incidence of esophageal varices in cirrhosis. Gastroenterology. 2001, 20 (5): A2-CrossRef D’Amico G, Pasta L, Madonia S, Tarantino I, Mancuso A, Malizia G, Giannuoli G, Pagliaro L: The incidence of esophageal varices in cirrhosis. Gastroenterology. 2001, 20 (5): A2-CrossRef
14.
go back to reference D’Amico G, Morabito A, Pagliaro L, Marubini E: Survival and prognostic indicators in compensated and decompensated cirrhosis. Dig Dis Sci. 1986, 31 (5): 468-475. 10.1007/BF01320309.CrossRefPubMed D’Amico G, Morabito A, Pagliaro L, Marubini E: Survival and prognostic indicators in compensated and decompensated cirrhosis. Dig Dis Sci. 1986, 31 (5): 468-475. 10.1007/BF01320309.CrossRefPubMed
15.
go back to reference Soares MO, Bojke L, Dumville J, Iglesias C, Cullum N, Claxton K: Methods to elicit experts’ beliefs over uncertain quantities: application to a cost effectiveness transition model of negative pressure wound therapy for severe pressure ulceration. Stat Med. 2011, 30 (19): 2363-2380. 10.1002/sim.4288.CrossRefPubMed Soares MO, Bojke L, Dumville J, Iglesias C, Cullum N, Claxton K: Methods to elicit experts’ beliefs over uncertain quantities: application to a cost effectiveness transition model of negative pressure wound therapy for severe pressure ulceration. Stat Med. 2011, 30 (19): 2363-2380. 10.1002/sim.4288.CrossRefPubMed
16.
go back to reference Cahan A, Gilon D, Manor O, Paltiel O: Clinical experience did not reduce the variance in physicians’ estimates of pretest probability in a cross-sectional survey. J Clin Epidemiol. 2005, 58 (11): 1211-1216. 10.1016/j.jclinepi.2005.02.014.CrossRefPubMed Cahan A, Gilon D, Manor O, Paltiel O: Clinical experience did not reduce the variance in physicians’ estimates of pretest probability in a cross-sectional survey. J Clin Epidemiol. 2005, 58 (11): 1211-1216. 10.1016/j.jclinepi.2005.02.014.CrossRefPubMed
17.
go back to reference Cahan A, Gilon D, Manor O, Paltiel O: Probabilistic reasoning and clinical decision-making: do doctors overestimate diagnostic probabilities?. QJM. 2003, 96 (10): 763-769. 10.1093/qjmed/hcg122.CrossRefPubMed Cahan A, Gilon D, Manor O, Paltiel O: Probabilistic reasoning and clinical decision-making: do doctors overestimate diagnostic probabilities?. QJM. 2003, 96 (10): 763-769. 10.1093/qjmed/hcg122.CrossRefPubMed
18.
go back to reference Tversky A, Koehler D: Support theory: a nonextentional representation of subjective probability. Psychol Rev. 1994, 101: 547-567.CrossRef Tversky A, Koehler D: Support theory: a nonextentional representation of subjective probability. Psychol Rev. 1994, 101: 547-567.CrossRef
19.
go back to reference Rottenstreich Y, Tversky A: Unpacking, repacking, and anchoring: advances in support theory. Psychol Rev. 1997, 104 (2): 406-415.CrossRefPubMed Rottenstreich Y, Tversky A: Unpacking, repacking, and anchoring: advances in support theory. Psychol Rev. 1997, 104 (2): 406-415.CrossRefPubMed
20.
go back to reference Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998, 2 (3): 1-88. Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998, 2 (3): 1-88.
21.
go back to reference Kahneman D, Slovic P, Tversky A: Judgment under uncertainty: heuristics and biases. Cambridge. 1982, New York: Cambridge University PressCrossRef Kahneman D, Slovic P, Tversky A: Judgment under uncertainty: heuristics and biases. Cambridge. 1982, New York: Cambridge University PressCrossRef
22.
go back to reference Tversky A, Kahneman D: Judgment under uncertainty: heuristics and biases. Science. 1974, 185 (4157): 1124-1131. 10.1126/science.185.4157.1124.CrossRefPubMed Tversky A, Kahneman D: Judgment under uncertainty: heuristics and biases. Science. 1974, 185 (4157): 1124-1131. 10.1126/science.185.4157.1124.CrossRefPubMed
23.
go back to reference Tversky A, Kahneman D: Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment. Psychol Rev. 1983, 90 (4): 293-315.CrossRef Tversky A, Kahneman D: Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment. Psychol Rev. 1983, 90 (4): 293-315.CrossRef
24.
go back to reference Powell C: The Delphi technique: myths and realities. J Adv Nurs. 2003, 41 (4): 376-382. 10.1046/j.1365-2648.2003.02537.x.CrossRefPubMed Powell C: The Delphi technique: myths and realities. J Adv Nurs. 2003, 41 (4): 376-382. 10.1046/j.1365-2648.2003.02537.x.CrossRefPubMed
25.
go back to reference Sackman H: Delphi critique; expert opinion, forecasting, and group process. 1975, Lexington, Mass: Lexington Books Sackman H: Delphi critique; expert opinion, forecasting, and group process. 1975, Lexington, Mass: Lexington Books
26.
go back to reference Graham B, Regehr G, Wright JG: Delphi as a method to establish consensus for diagnostic criteria. J Clin Epidemiol. 2003, 56 (12): 1150-1156. 10.1016/S0895-4356(03)00211-7.CrossRefPubMed Graham B, Regehr G, Wright JG: Delphi as a method to establish consensus for diagnostic criteria. J Clin Epidemiol. 2003, 56 (12): 1150-1156. 10.1016/S0895-4356(03)00211-7.CrossRefPubMed
27.
go back to reference van Noortwijk J, Deker A, Cooke R, Mazzuchi T: Expert judgment in maintenance optimization. IEEE Trans Reliab. 1992, 41: 427-432. 10.1109/24.159813.CrossRef van Noortwijk J, Deker A, Cooke R, Mazzuchi T: Expert judgment in maintenance optimization. IEEE Trans Reliab. 1992, 41: 427-432. 10.1109/24.159813.CrossRef
28.
go back to reference O’Hagan A: Uncertain judgements: eliciting experts’ probabilities. 2006, Chichester: WileyCrossRef O’Hagan A: Uncertain judgements: eliciting experts’ probabilities. 2006, Chichester: WileyCrossRef
Metadata
Title
Is expert opinion reliable when estimating transition probabilities? The case of HCV-related cirrhosis in Egypt
Authors
Anthony Cousien
Dorothée Obach
Sylvie Deuffic-Burban
Aya Mostafa
Gamal Esmat
Valérie Canva
Mohamed El Kassas
Mohammad El-Sayed
Wagida A Anwar
Arnaud Fontanet
Mostafa K Mohamed
Yazdan Yazdanpanah
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-39

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue