Skip to main content
Top
Published in: Cost Effectiveness and Resource Allocation 1/2012

Open Access 01-12-2012 | Research

Field testing of a multicriteria decision analysis (MCDA) framework for coverage of a screening test for cervical cancer in South Africa

Authors: Jacqui Miot, Monika Wagner, Hanane Khoury, Donna Rindress, Mireille M Goetghebeur

Published in: Cost Effectiveness and Resource Allocation | Issue 1/2012

Login to get access

Abstract

Background

Systematic and transparent approaches to priority setting are needed, particularly in low-resource settings, to produce decisions that are sound and acceptable to stakeholders. The EVIDEM framework brings together Health Technology Assessment (HTA) and multi-criteria decision analysis (MCDA) by proposing a comprehensive set of decision criteria together with standardized processes to support decisionmaking. The objective of the study was to field test the framework for decisionmaking on a screening test by a private health plan in South Africa.

Methods

Liquid-based cytology (LBC) for cervical cancer screening was selected by the health plan for this field test. An HTA report structured by decision criterion (14 criteria organized in the MCDA matrix and 4 contextual criteria) was produced based on a literature review and input from the health plan. During workshop sessions, committee members 1) weighted each MCDA decision criterion to express their individual perspectives, and 2) to appraise LBC, assigned scores to each MCDA criterion on the basis of the by-criterion HTA report.
Committee members then considered the potential impacts of four contextual criteria on the use of LBC in the context of their health plan. Feedback on the framework and process was collected through discussion and from a questionnaire.

Results

For 9 of the MCDA matrix decision criteria, 89% or more of committee members thought they should always be considered in decisionmaking. Greatest weights were given to the criteria "Budget impact", "Cost-effectiveness" and "Completeness and consistency of reporting evidence". When appraising LBC for cervical cancer screening, the committee assigned the highest scores to "Relevance and validity of evidence" and "Disease severity". Combination of weights and scores yielded a mean MCDA value estimate of 46% (SD 7%) of the potential maximum value. Overall, the committee felt the framework brought greater clarity to the decisionmaking process and was easily adaptable to different types of health interventions.

Conclusions

The EVIDEM framework was easily adapted to evaluating a screening technology in South Africa, thereby broadening its applicability in healthcare decision making.
Appendix
Available only for authorised users
Literature
1.
go back to reference Baltussen R, Niessen L: Priority setting of health interventions: the need for multi-criteria decision analysis. Cost Eff Resour Alloc 2006, 4: 14. 10.1186/1478-7547-4-14PubMedCentralPubMedCrossRef Baltussen R, Niessen L: Priority setting of health interventions: the need for multi-criteria decision analysis. Cost Eff Resour Alloc 2006, 4: 14. 10.1186/1478-7547-4-14PubMedCentralPubMedCrossRef
2.
go back to reference Tunis SR: Reflections on science, judgment, and value in evidence-based decision making: a conversation with David Eddy. Health Aff (Millwood) 2007, 26: w500-w515. 10.1377/hlthaff.26.4.w500CrossRef Tunis SR: Reflections on science, judgment, and value in evidence-based decision making: a conversation with David Eddy. Health Aff (Millwood) 2007, 26: w500-w515. 10.1377/hlthaff.26.4.w500CrossRef
3.
go back to reference Youngkong S, Kapiriri L, Baltussen R: Setting priorities for health interventions in developing countries: a review of empirical studies. Trop Med Int Health 2009, 14: 930–939. 10.1111/j.1365-3156.2009.02311.xPubMedCrossRef Youngkong S, Kapiriri L, Baltussen R: Setting priorities for health interventions in developing countries: a review of empirical studies. Trop Med Int Health 2009, 14: 930–939. 10.1111/j.1365-3156.2009.02311.xPubMedCrossRef
4.
go back to reference Bryan S, Williams I, McIver S: Seeing the NICE side of cost-effectiveness analysis: a qualitative investigation of the use of CEA in NICE technology appraisals. Health Econ 2007, 16: 179–193. 10.1002/hec.1133PubMedCrossRef Bryan S, Williams I, McIver S: Seeing the NICE side of cost-effectiveness analysis: a qualitative investigation of the use of CEA in NICE technology appraisals. Health Econ 2007, 16: 179–193. 10.1002/hec.1133PubMedCrossRef
6.
go back to reference Vuorenkoski L, Toiviainen H, Hemminki E: Decision-making in priority setting for medicines-a review of empirical studies. Health Policy 2008, 86: 1–9. 10.1016/j.healthpol.2007.09.007PubMedCrossRef Vuorenkoski L, Toiviainen H, Hemminki E: Decision-making in priority setting for medicines-a review of empirical studies. Health Policy 2008, 86: 1–9. 10.1016/j.healthpol.2007.09.007PubMedCrossRef
7.
go back to reference Daniels N, Sabin J: Limits to health care: fair procedures, democratic deliberation, and the legitimacy problem for insurers. Philos Public Aff 1997, 26: 303–350. 10.1111/j.1088-4963.1997.tb00082.xPubMedCrossRef Daniels N, Sabin J: Limits to health care: fair procedures, democratic deliberation, and the legitimacy problem for insurers. Philos Public Aff 1997, 26: 303–350. 10.1111/j.1088-4963.1997.tb00082.xPubMedCrossRef
8.
go back to reference Doherty J: Cost-effectiveness analysis for priority setting in South Africa - what are the possibilities? S Afr Med J 2010, 100: 816–821.PubMed Doherty J: Cost-effectiveness analysis for priority setting in South Africa - what are the possibilities? S Afr Med J 2010, 100: 816–821.PubMed
9.
go back to reference Cleary SM, McIntyre D, Boulle AM: The cost-effectiveness of antiretroviral treatment in Khayelitsha, South Africa-a primary data analysis. Cost Eff Resour Alloc 2006, 4: 20. 10.1186/1478-7547-4-20PubMedCentralPubMedCrossRef Cleary SM, McIntyre D, Boulle AM: The cost-effectiveness of antiretroviral treatment in Khayelitsha, South Africa-a primary data analysis. Cost Eff Resour Alloc 2006, 4: 20. 10.1186/1478-7547-4-20PubMedCentralPubMedCrossRef
10.
go back to reference Cleary SM, McIntyre D, Boulle AM: Assessing efficiency and costs of scaling up HIV treatment. AIDS 2008,22(Suppl 1):S35-S42. 10.1097/01.aids.0000327621.24232.71PubMedCrossRef Cleary SM, McIntyre D, Boulle AM: Assessing efficiency and costs of scaling up HIV treatment. AIDS 2008,22(Suppl 1):S35-S42. 10.1097/01.aids.0000327621.24232.71PubMedCrossRef
11.
go back to reference Camidge DR, Oliver JJ, Skinner C, Attwood B, Nussey F, Jodrell D, et al.: The impact of prognosis without treatment on doctors' and patients' resource allocation decisions and its relevance to new drug recommendation processes. Br J Clin Pharmacol 2008, 65: 224–229. 10.1111/j.1365-2125.2007.02996.xPubMedCentralPubMedCrossRef Camidge DR, Oliver JJ, Skinner C, Attwood B, Nussey F, Jodrell D, et al.: The impact of prognosis without treatment on doctors' and patients' resource allocation decisions and its relevance to new drug recommendation processes. Br J Clin Pharmacol 2008, 65: 224–229. 10.1111/j.1365-2125.2007.02996.xPubMedCentralPubMedCrossRef
12.
go back to reference Schlander M: The use of cost-effectiveness by the National Institute for Health and Clinical Excellence (NICE): no(t yet an) exemplar of a deliberative process. J Med Ethics 2008, 34: 534–539. 10.1136/jme.2007.021683PubMedCrossRef Schlander M: The use of cost-effectiveness by the National Institute for Health and Clinical Excellence (NICE): no(t yet an) exemplar of a deliberative process. J Med Ethics 2008, 34: 534–539. 10.1136/jme.2007.021683PubMedCrossRef
13.
go back to reference Baltussen R, Youngkong S, Paolucci F, Niessen L: Multi-criteria decision analysis to prioritize health interventions: Capitalizing on first experiences. Health Policy 2010, 86: 262–264.CrossRef Baltussen R, Youngkong S, Paolucci F, Niessen L: Multi-criteria decision analysis to prioritize health interventions: Capitalizing on first experiences. Health Policy 2010, 86: 262–264.CrossRef
14.
go back to reference Dolan JG: Multi-Criteria clinical decision support. A primer on the use of multiple-criteria decision-making methods to promote evidence-based, patient-centered healthcare. Patient 2010, 3: 229–248.PubMedCentralPubMedCrossRef Dolan JG: Multi-Criteria clinical decision support. A primer on the use of multiple-criteria decision-making methods to promote evidence-based, patient-centered healthcare. Patient 2010, 3: 229–248.PubMedCentralPubMedCrossRef
15.
go back to reference Browman GP, Manns B, Hagen N, Chambers CR, Simon A, Sinclair S: 6-STEPPPs: A modular tool to facilitate clinician participation in fair decisions for funding new cancer drugs. J Oncol Practice 2008, 4: 2–7. 10.1200/JOP.0812001CrossRef Browman GP, Manns B, Hagen N, Chambers CR, Simon A, Sinclair S: 6-STEPPPs: A modular tool to facilitate clinician participation in fair decisions for funding new cancer drugs. J Oncol Practice 2008, 4: 2–7. 10.1200/JOP.0812001CrossRef
16.
go back to reference Martin DK, Pater JL, Singer PA: Priority-setting decisions for new cancer drugs: a qualitative case study. Lancet 2001, 358: 1676–1681. 10.1016/S0140-6736(01)06714-9PubMedCrossRef Martin DK, Pater JL, Singer PA: Priority-setting decisions for new cancer drugs: a qualitative case study. Lancet 2001, 358: 1676–1681. 10.1016/S0140-6736(01)06714-9PubMedCrossRef
17.
go back to reference Mullen PM: Quantifying priorities in healthcare: transparency or illusion? Health Serv Manage Res 2004, 17: 47–58. 10.1258/095148404322772723PubMedCrossRef Mullen PM: Quantifying priorities in healthcare: transparency or illusion? Health Serv Manage Res 2004, 17: 47–58. 10.1258/095148404322772723PubMedCrossRef
18.
go back to reference Wilson E, Sussex J, Macleod C, Fordham R: Prioritizing health technologies in a Primary Care Trust. J Health Serv Res Policy 2007, 12: 80–85. 10.1258/135581907780279495PubMedCrossRef Wilson E, Sussex J, Macleod C, Fordham R: Prioritizing health technologies in a Primary Care Trust. J Health Serv Res Policy 2007, 12: 80–85. 10.1258/135581907780279495PubMedCrossRef
19.
go back to reference Wilson EC, Peacock SJ, Ruta D: Priority setting in practice: what is the best way to compare costs and benefits? Health Econ 2009, 18: 467–478. 10.1002/hec.1380PubMedCrossRef Wilson EC, Peacock SJ, Ruta D: Priority setting in practice: what is the best way to compare costs and benefits? Health Econ 2009, 18: 467–478. 10.1002/hec.1380PubMedCrossRef
20.
go back to reference Baltussen R, Ten Asbroek AH, Koolman X, Shrestha N, Bhattarai P, Niessen LW: Priority setting using multiple criteria: should a lung health programme be implemented in Nepal? Health Policy Plan 2007, 22: 178–185. 10.1093/heapol/czm010PubMedCrossRef Baltussen R, Ten Asbroek AH, Koolman X, Shrestha N, Bhattarai P, Niessen LW: Priority setting using multiple criteria: should a lung health programme be implemented in Nepal? Health Policy Plan 2007, 22: 178–185. 10.1093/heapol/czm010PubMedCrossRef
21.
go back to reference Nobre FF, Trotta LT, Gomes LF: Multi-criteria decision making-an approach to setting priorities in health care. Stat Med 1999, 18: 3345–3354. 10.1002/(SICI)1097-0258(19991215)18:23<3345::AID-SIM321>3.0.CO;2-7PubMedCrossRef Nobre FF, Trotta LT, Gomes LF: Multi-criteria decision making-an approach to setting priorities in health care. Stat Med 1999, 18: 3345–3354. 10.1002/(SICI)1097-0258(19991215)18:23<3345::AID-SIM321>3.0.CO;2-7PubMedCrossRef
22.
go back to reference Goetghebeur M, Wagner M, Khoury H, Levitt R, Erickson LJ, Rindress D: Evidence and Value: Impact on DEcisionMaking - the EVIDEM framework and potential applications. BMC Health Services Research 2008, 8: 270. 10.1186/1472-6963-8-270PubMedCentralPubMedCrossRef Goetghebeur M, Wagner M, Khoury H, Levitt R, Erickson LJ, Rindress D: Evidence and Value: Impact on DEcisionMaking - the EVIDEM framework and potential applications. BMC Health Services Research 2008, 8: 270. 10.1186/1472-6963-8-270PubMedCentralPubMedCrossRef
23.
go back to reference Goetghebeur MM, Wagner M, Khoury H, Levitt RJ, Erickson LJ, Rindress D: Bridging health technology assessment (HTA) and efficient health care decision making with multicriteria decision analysis (MCDA): Applying the EVIDEM framework to medicines appraisal (ahead of print). Med Decis Making 2011, in press. Goetghebeur MM, Wagner M, Khoury H, Levitt RJ, Erickson LJ, Rindress D: Bridging health technology assessment (HTA) and efficient health care decision making with multicriteria decision analysis (MCDA): Applying the EVIDEM framework to medicines appraisal (ahead of print). Med Decis Making 2011, in press.
24.
go back to reference Goetghebeur MM, Wagner M, Khoury H, Rindress D, Gregoire JP, Deal C: Combining multicriteria decision analysis, ethics and health technology assessment: applying the EVIDEM decisionmaking framework to growth hormone for Turner syndrome patients. Cost Eff Resour Alloc 2010, 8: 4. 10.1186/1478-7547-8-4PubMedCentralPubMedCrossRef Goetghebeur MM, Wagner M, Khoury H, Rindress D, Gregoire JP, Deal C: Combining multicriteria decision analysis, ethics and health technology assessment: applying the EVIDEM decisionmaking framework to growth hormone for Turner syndrome patients. Cost Eff Resour Alloc 2010, 8: 4. 10.1186/1478-7547-8-4PubMedCentralPubMedCrossRef
25.
go back to reference Tony M, Wagner M, Khoury H, Rindress D, Papastavros T, Oh P, et al.: Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada. BMC Health Serv Res 2011, 11: 329. 10.1186/1472-6963-11-329PubMedCentralPubMedCrossRef Tony M, Wagner M, Khoury H, Rindress D, Papastavros T, Oh P, et al.: Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada. BMC Health Serv Res 2011, 11: 329. 10.1186/1472-6963-11-329PubMedCentralPubMedCrossRef
27.
go back to reference Cronje HS, Beyer E: Screening for cervical cancer in an African setting. Int J Gynaecol Obstet 2007, 98: 168–171. 10.1016/j.ijgo.2007.05.005PubMedCrossRef Cronje HS, Beyer E: Screening for cervical cancer in an African setting. Int J Gynaecol Obstet 2007, 98: 168–171. 10.1016/j.ijgo.2007.05.005PubMedCrossRef
29.
go back to reference Adriano E, Jagoe JM, Harrison T, Riffenburgh RH, Johnstone PA: Survival of patients with untreated cervical carcinoma. Am J Clin Oncol 2003, 26: 369–373.PubMed Adriano E, Jagoe JM, Harrison T, Riffenburgh RH, Johnstone PA: Survival of patients with untreated cervical carcinoma. Am J Clin Oncol 2003, 26: 369–373.PubMed
30.
32.
go back to reference Franco EL, Duarte-Franco E, Ferenczy A: Cervical cancer: epidemiology, prevention and the role of human papillomavirus infection. CMAJ 2001, 164: 1017–1025.PubMedCentralPubMed Franco EL, Duarte-Franco E, Ferenczy A: Cervical cancer: epidemiology, prevention and the role of human papillomavirus infection. CMAJ 2001, 164: 1017–1025.PubMedCentralPubMed
33.
go back to reference Bailie RS, Selvey CE, Bourne D, Bradshaw D: Trends in cervical cancer mortality in South Africa. Int J Epidemiol 1996, 25: 488–493. 10.1093/ije/25.3.488PubMedCrossRef Bailie RS, Selvey CE, Bourne D, Bradshaw D: Trends in cervical cancer mortality in South Africa. Int J Epidemiol 1996, 25: 488–493. 10.1093/ije/25.3.488PubMedCrossRef
36.
go back to reference Anderson N, Discovery Health: Internal Report prepared for Discovery Health: Summary of liquid-based cytology. 2008. Anderson N, Discovery Health: Internal Report prepared for Discovery Health: Summary of liquid-based cytology. 2008.
37.
go back to reference Discovery Health: Internal Report prepared for Discovery Health: Pap smear analysis updated 02. 2008. Discovery Health: Internal Report prepared for Discovery Health: Pap smear analysis updated 02. 2008.
38.
go back to reference Parrish A, Blockman M: Clinical excellence and the NICEties of value-based priority setting. S Afr Med J 2008, 98: 758–761.PubMed Parrish A, Blockman M: Clinical excellence and the NICEties of value-based priority setting. S Afr Med J 2008, 98: 758–761.PubMed
39.
go back to reference Kenyon C, Ford N, Boulle A: When best practice is bad medicine: a new approach to rationing tertiary health services in South Africa. S Afr Med J 2008, 98: 350. 352, 354PubMed Kenyon C, Ford N, Boulle A: When best practice is bad medicine: a new approach to rationing tertiary health services in South Africa. S Afr Med J 2008, 98: 350. 352, 354PubMed
40.
go back to reference Nutt DJ, King LA, Phillips LD: Drug harms in the UK: a multicriteria decision analysis. Lancet 2010, 376: 1558–1565. 10.1016/S0140-6736(10)61462-6PubMedCrossRef Nutt DJ, King LA, Phillips LD: Drug harms in the UK: a multicriteria decision analysis. Lancet 2010, 376: 1558–1565. 10.1016/S0140-6736(10)61462-6PubMedCrossRef
Metadata
Title
Field testing of a multicriteria decision analysis (MCDA) framework for coverage of a screening test for cervical cancer in South Africa
Authors
Jacqui Miot
Monika Wagner
Hanane Khoury
Donna Rindress
Mireille M Goetghebeur
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Cost Effectiveness and Resource Allocation / Issue 1/2012
Electronic ISSN: 1478-7547
DOI
https://doi.org/10.1186/1478-7547-10-2

Other articles of this Issue 1/2012

Cost Effectiveness and Resource Allocation 1/2012 Go to the issue