Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Orphanet Journal of Rare Diseases
Published in: Orphanet Journal of Rare Diseases 1/2019

Open Access 01-12-2019 | Research

Cost-effectiveness analysis of three algorithms for diagnosing primary ciliary dyskinesia: a simulation study

Authors: Panayiotis Kouis, Stefania I. Papatheodorou, Nicos Middleton, George Giallouros, Kyriacos Kyriacou, Joshua T. Cohen, John S. Evans, Panayiotis K. Yiallouros

Published in: Orphanet Journal of Rare Diseases | Issue 1/2019

Login to get access

Abstract

Background

Primary Ciliary Dyskinesia (PCD) diagnosis relies on a combination of tests which may include (a) nasal Nitric Oxide (nNO), (b) High Speed Video Microscopy (HSVM) and (c) Transmission Electron Microscopy (TEM). There is variability in the availability of these tests and lack of universal agreement whether diagnostic tests should be performed in sequence or in parallel. We assessed three combinations of tests for PCD diagnosis and estimated net sensitivity and specificity as well as cost-effectiveness (CE) and incremental cost-effectiveness (ICE) ratios.

Methods and results

A hypothetical initial population of 1000 referrals (expected 320 PCD patients) was followed through a probabilistic decision analysis model which was created to assess the CE of three diagnostic algorithms (a) nNO + TEM in sequence, (b) nNO + HSVM in sequence and (c) nNO/HSVM in parallel followed, in cases with conflicting results, by confirmatory TEM (nNO/HSVM+TEM). Number of PCD patients identified, CE and ICE ratios were calculated using Monte Carlo simulations. Out of 320 expected PCD patients, 313 were identified by nNO/HSVM+TEM, 274 with nNO + HSVM and 198 with nNO + TEM. The nNO/HSVM+TEM had the highest mean annual cost (€209 K) followed by nNO + TEM (€150 K) and nNO + HSVM (€136 K). The nNO + HSVM algorithm dominated the nNO + TEM algorithm (less costly and more effective). The ICE ratio for nNO/HSVM+TEM was €2.1 K per additional PCD patient identified.

Conclusions

The diagnostic algorithm (nNO/HSVM+TEM) with parallel testing outperforms algorithms with tests in sequence. These findings, can inform the dialogue on the development of evidence-based guidelines for PCD diagnostic testing. Future research in understudied aspects of the disease, such as PCD-related quality of life and PCD-associated costs, is needed to help the better implementation of these guidelines across various healthcare systems.
Appendix
Available only for authorised users
Literature
1.
Knowles MR, Daniels LA, Davis SD, Zariwala MA, Leigh MW. Primary ciliary dyskinesia. Recent advances in diagnostics, genetics, and characterization of clinical disease. Am J Respir Crit Care Med. 2013;188(8):913–22.CrossRef
2.
Noone PG, Leigh MW, Sannuti A, Minnix SL, Carson JL, Hazucha M, Zariwala MA, Knowles MR. Primary ciliary dyskinesia: diagnostic and phenotypic features. Am J Respir Crit Care Med. 2004;169(4):459–67.CrossRef
3.
Kurkowiak M, Zietkiewicz E, Witt M. Recent advances in primary ciliary dyskinesia genetics. J Med Genet. 2015;52(1):1–9.CrossRef
4.
Magnin ML, Cros P, Beydon N, Mahloul M, Tamalet A, Escudier E, Clément A, Pointe L, Ducou H, Blanchon S. Longitudinal lung function and structural changes in children with primary ciliary dyskinesia. Pediatr Pulmonol. 2012;47(8):816–25.CrossRef
5.
Honoré I, Burgel P. Primary ciliary dyskinesia in adults. Rev Mal Respir. 2016;33(2):165–189.3.CrossRef
6.
Coren M, Meeks M, Morrison I, Buchdahl R, Bush A. Primary ciliary dyskinesia: age at diagnosis and symptom history. Acta Paediatr. 2002;91(6):667–9.CrossRef
7.
Ellerman A, Bisgaard H. Longitudinal study of lung function in a cohort of primary ciliary dyskinesia. Eur Respir J. 1997;10(10):2376–2379.4-6.CrossRef
8.
Yiallouros PK, Kouis P, Middleton N, Nearchou M, Adamidi T, Georgiou A, Eleftheriou A, Ioannou P, Hadjisavvas A, Kyriacou K. Clinical features of primary ciliary dyskinesia in Cyprus with emphasis on lobectomized patients. Respir Med. 2015;109(3):347–56.CrossRef
9.
Vallet C, Escudier E, Roudot-Thoraval F, Blanchon S, Fauroux B, Beydon N, Boule M, Vojtek AM, Amselem S, Clément A, Tamalet A. Primary ciliary dyskinesia presentation in 60 children according to ciliary ultrastructure. Eur J Pediatr. 2013;172(8):1053–60.CrossRef
10.
Davis SD, Ferkol TW, Rosenfeld M, Lee HS, Dell SD, Sagel SD, Milla C, Zariwala MA, Pittman JE, Shapiro AJ, Carson JL, Krischer JP, Hazucha MJ, Cooper ML, Knowles MR, Leigh MW. Clinical features of childhood primary ciliary dyskinesia by genotype and ultrastructural phenotype. Am J Respir Crit Care Med. 2015;191(3):316–24.CrossRef
11.
Goutaki M, Meier AB, Halbeisen FS, Lucas JS, Dell SD, Maurer E, Casaulta C, Jurca M, Spycher BD, Kuehni CE. (2016) Clinical manifestations in primary ciliary dyskinesia: systematic review and meta-analysis. Eur Respir J. 2016;48(4):1081–95.CrossRef
12.
Shoemark A, Dixon M, Corrin B, Dewar A. Twenty-year review of quantitative transmission electron microscopy for the diagnosis of primary ciliary dyskinesia. J Clin Pathol. 2012;65(3):267–71.CrossRef
13.
Raidt J, Wallmeier J, Hjeij R, Onnebrink JG, Pennekamp P, Loges NT, Olbrich H, Haffner K, Dougherty GW, Omran H, Werner C. Ciliary beat pattern and frequency in genetic variants of primary ciliary dyskinesia. Eur Respir J. 2014;44(6):1579–88.CrossRef
14.
Hirst RA, Jackson CL, Coles JL, Williams G, Rutman A, Goggin PM, Adam EC, Page A, Evans HJ, Lackie PM, O’Callaghan C, Lucas JS. Culture of primary ciliary dyskinesia epithelial cells at air-liquid interface can alter ciliary phenotype but remains a robust and informative diagnostic aid. PLoS One. 2014;9(2):e89675.CrossRef
15.
Collins SA, Gove K, Walker W, Lucas JS. Nasal nitric oxide screening for primary ciliary dyskinesia: systematic review and meta-analysis. Eur Respir J. 2014;44(6):1589–99.CrossRef
16.
Chilvers MA, Rutman A, O'callaghan C. Ciliary beat pattern is associated with specific ultrastructural defects in primary ciliary dyskinesia. J Allergy Clin Immunol. 2003;112(3):518–24.CrossRef
17.
Sisson JH, Stoner J, Ammons B, Wyatt T. All-digital image capture and whole-field analysis of ciliary beat frequency. J Microsc. 2003;211(2):103–11.CrossRef
18.
Papon JF, Coste A, Roudot-Thoraval F, Boucherat M, Roger G, Tamalet A, Vojtek AM, Amselem S, Escudier E. A 20-year experience of electron microscopy in the diagnosis of primary ciliary dyskinesia. Eur Respir J. 2010;35(5):1057–63.CrossRef
19.
American Thoracic Society/European Respiratory Society. ATS/ERS recommendations for standardized procedures for the online and offline measurement of exhaled lower respiratory nitric oxide and nasal nitric oxide, 2005. Am J Respir Crit Care Med. 2005;171:912–30.CrossRef
20.
Barbato A, Frischer T, Kuehni CE, Snijders D, Azevedo I, Baktai G, Bartoloni L, Eber E, Escribano A, Haarman E, Hesselmar B, Hogg C, Jorissen M, Lucas J, Nielsen KG, O'Callaghan C, Omran H, Pohunek P, Strippoli MPF, Bush A. Primary ciliary dyskinesia: a consensus statement on diagnostic and treatment approaches in children. Eur Respir J. 2009;34(6):1264–76.CrossRef
21.
Lucas JS, Burgess A, Mitchison HM, Moya E, Williamson M, Hogg C. National PCD service U: diagnosis and management of primary ciliary dyskinesia. Arch Dis Child. 2014;99(9):850–6.CrossRef
22.
Lucas JS, Leigh MW. Diagnosis of primary ciliary dyskinesia: searching for a gold standard. Eur Respir J. 2014;44(6):1418–22.CrossRef
23.
Marthin JK, Nielsen KG. Choice of nasal nitric oxide technique as first-line test for primary ciliary dyskinesia. Eur Respir J. 2011;37(3):559–65.CrossRef
24.
Marthin JK, Nielsen KG. Hand-held tidal breathing nasal nitric oxide measurement–a promising targeted case-finding tool for the diagnosis of primary ciliary dyskinesia. PLoS One. 2013;8(2):e57262.CrossRef
25.
26.
Lucas JS, Barbato A, Collins SA, Goutaki M, Behan L, Caudri D, Dell S, Eber E, Escudier E, Hirst RA, Hogg C, Jorissen M, Latzin P, Legendre M, Leigh MW, Midulla F, Nielsen KG, Omran H, Papon JF, Pohunek P, Redfern B, Rigau D, Rindlisbacher B, Santamaria F, Shoemark A, Snijders D, Tonia T, Titieni A, Walker WT, Werner C, Bush A, Kuehni CE. European Respiratory Society guidelines for the diagnosis of primary ciliary dyskinesia. Eur Respir J. 2017;49(1). https://​doi.​org/​10.​1183/​13993003.​01090-2016 Print 2017 Jan.CrossRef
27.
Sox HC. Medical decision making. Philadelphia: ACP Press; 1988.
28.
Xu X, Nardini HKG, Ruger JP. Micro-costing studies in the health and medical literature: protocol for a systematic review. Systematic reviews. 2014;3(1):47.CrossRef
29.
Owens DK. Interpretation of cost-effectiveness analyses. J Gen Intern Med. 1998;13(10):716–7.CrossRef
30.
Gray AM, Clarke PM, Wolstenholme JL, Wordsworth S. Applied methods of cost-effectiveness analysis in healthcare, vol. 3. Oxford: Oxford University Press; 2011.
31.
Neumann PJ, Thorat T, Shi J, Saret CJ, Cohen JT. The changing face of the cost-utility literature, 1990–2012. Value Health. 2015;18(2):271–7.CrossRef
32.
Kouis P, Yiallouros PK, Middleton N, Evans JS, Kyriacou K, Papatheodorou SI. Prevalence of primary ciliary dyskinesia in consecutive referrals of suspect cases and the transmission electron microscopy detection rate: a systematic review and meta-analysis. Pediatr Res. 2017;81(3):398–405.CrossRef
33.
Kouis P, Papatheodorou SI, Yiallouros PK. Diagnostic accuracy of nasal nitric oxide for establishing diagnosis of primary ciliary dyskinesia: a meta-analysis. BMC pulmonary medicine. 2015;15(1):153.CrossRef
34.
Boon M, Jorissen M, Jaspers M, Cuppens H, De Boeck K. Is the sensitivity of primary ciliary dyskinesia detection by ciliary function analysis 100%? Eur Respir J. 2013;42(4):1159–61.CrossRef
35.
Jackson CL, Behan L, Collins SA, Goggin PM, Adam EC, Coles JL, Evans HJ, Harris A, Lackie P, Packham S, Page A, Thompson J, Walker WT, Kuehni C, Lucas JS. Accuracy of diagnostic testing in primary ciliary dyskinesia. Eur Respir J. 2016;47(3):837–48.CrossRef
36.
Van Hout BA, Al MJ, Gordon GS, Rutten FF. Costs, effects and C/E-ratios alongside a clinical trial. Health Econ. 1994;3(5):309–19.CrossRef
37.
Judgements SV. Principles for the development of NICE guidance. London: National Institute for health and care excellence; 2008. p. 478.
38.
Shiroiwa T, Sung Y, Fukuda T, Lang H, Bae S, Tsutani K. International survey on willingness-to-pay (WTP) for one additional QALY gained: what is the threshold of cost effectiveness? Health Econ. 2010;19(4):422–37.CrossRef
39.
Neumann PJ, Cohen JT, Weinstein MC. Updating cost-effectiveness—the curious resilience of the $50,000-per-QALY threshold. N Engl J Med. 2014;371(9):796–7.CrossRef
40.
Schwabe GC, Hoffmann K, Loges NT, Birker D, Rossier C, De Santi MM, Olbrich H, Fliegauf M, Failly M, Liebers U. Primary ciliary dyskinesia associated with normal axoneme ultrastructure is caused by DNAH11 mutations. Hum Mutat. 2008;29(2):289–98.CrossRef
41.
Olbrich H, Cremers C, Loges NT, Werner C, Nielsen KG, Marthin JK, Philipsen M, Wallmeier J, Pennekamp P, Menchen T. Loss-of-function GAS8 mutations cause primary ciliary dyskinesia and disrupt the nexin-dynein regulatory complex. Am J Hum Genet. 2015;97(4):546–54.CrossRef
42.
Leigh MW, O'callaghan C, Knowles MR. The challenges of diagnosing primary ciliary dyskinesia. Proc Am Thorac Soc. 2011;8(5):434–7.CrossRef
43.
Behan L, Dunn Galvin A, Rubbo B, Masefield S, Copeland F, Manion M, Rindlisbacher B, Redfern B, Lucas JS. Diagnosing primary ciliary dyskinesia: an international patient perspective. Eur Respir J. 2016;48(4):1096–107.CrossRef
44.
Shoemark A, Frost E, Dixon M, Ollosson S, Kilpin K, Patel M, Scully J, Rogers AV, Mitchison HM, Bush A: Accuracy of immunofluorescence in the diagnosis of primary ciliary dyskinesia. Am J Respir Crit Care Med. 2017;196(1):94–101.CrossRef
45.
Boaretto F, Snijders D, Salvoro C, Spalletta A, Mostacciuolo ML, Collura M, Cazzato S, Girosi D, Silvestri M, Rossi GA. Diagnosis of primary ciliary dyskinesia by a targeted next-generation sequencing panel: molecular and clinical findings in Italian patients. J Mol Diagn. 2016;18(6):912–22.CrossRef
46.
Kim RH, A Hall D, Cutz E, Knowles MR, Nelligan KA, Nykamp K, Zariwala MA, Dell SD. The role of molecular genetic analysis in the diagnosis of primary ciliary dyskinesia. Ann Am Thorac Soc. 2014;11(3):351–9.CrossRef
47.
Leigh MW, Hazucha MJ, Chawla KK, Baker BR, Shapiro AJ, Brown DE, LaVange LM, Horton BJ, Qaqish B, Carson JL. Standardizing nasal nitric oxide measurement as a test for primary ciliary dyskinesia. Ann Am Thorac Soc. 2013;10(6):574–81.CrossRef
48.
Harris A, Bhullar E, Gove K, Joslin R, Pelling J, Evans HJ, Walker WT, Lucas JS. Validation of a portable nitric oxide analyzer for screening in primary ciliary dyskinesias. BMC Pulm Med. 2014;14(1):18.CrossRef
49.
50.
O’Callaghan C, Chilvers M, Hogg C, Bush A, Lucas J. Diagnosing primary ciliary dyskinesia. Thorax. 2007;62:656–7.CrossRef
51.
Kuehni CE, Frischer T, Strippoli MP, et al. ERS task force on primary ciliary dyskinesia in children. Factors influencing age at diagnosis of primary ciliary dyskinesia in European children. Eur Respir J. 2010;36:1248–58.CrossRef
52.
Behan L, Dimitrov BD, Kuehni CE, Hogg C, Carroll M, Evans HJ, Goutaki M, Harris A, Packham S, Walker WT, Lucas JS. PICADAR: a diagnostic predictive tool for primary ciliary dyskinesia. Eur Respir J. 2016;47(4):1103–12.CrossRef
53.
Rubbo B, Behan L, Dehlink E, Goutaki M, Hogg C, Kouis P, Kuehni CE, Latzin P, Nielsen K, Norris D, Nyilas S, Price M, Lucas JS. Proceedings of the COST action BM1407 inaugural conference BEAT-PCD: translational research in primary ciliary dyskinesia-bench, bedside, and population perspectives. BMC Proc. 2016;10(Suppl. 9):66 BioMed Central.CrossRef
54.
Héon-Klin V. European reference networks for rare diseases: what is the conceptual framework? Orphanet J Rare Dis. 2017;12(1):137.CrossRef
55.
Kobbernagel HE, Buchvald FF, Haarman EG, Casaulta C, Collins SA, Hogg C, Kuehni CE, Lucas JS, Omran H, Quittner AL. Study protocol, rationale and recruitment in a European multi-Centre randomized controlled trial to determine the efficacy and safety of azithromycin maintenance therapy for 6 months in primary ciliary dyskinesia. BMC Pulm Med. 2016;16(1):104.CrossRef
56.
Chevreul K, Michel M, Brigham KB, López-Bastida J, Linertová R, Oliva-Moreno J, Serrano-Aguilar P, Posada-de-la-Paz M, Taruscio D, Schieppati A, Iskrov G, Pentek M, von der Schulenburg JMG, Kanavos P, Persson U, Fattore G. BURQOL-RD research network. Social/economic costs and health-related quality of life in patients with cystic fibrosis in Europe. Eur J Health Econ. 2016;17(1):7–18.CrossRef
57.
58.
59.
60.
Frija-Masson J, Bassinet L, Honoré I, Dufeu N, Housset B, Coste A, Papon JF, Escudier E, Burgel PR, Maître B. Clinical characteristics, functional respiratory decline and follow-up in adult patients with primary ciliary dyskinesia. Thorax. 2017;72(2):154–60.CrossRef
61.
Werner C, Lablans M, Ataian M, Raidt J, Wallmeier J, Grosse-Onnebrink J, Kuehni CE, Haarman EG, Leigh MW, Quittner AL, Lucas JS, Hogg C, Witt M, Priftis KN, Yiallouros P, Nielsen KG, Santamaria F, Uckert F, Omran H. An international registry for primary ciliary dyskinesia. Eur Respir J. 2016;47(3):849–59.CrossRef
62.
Cohen-Cymberknoh M, Simanovsky N, Hiller N, Hillel AG, Shoseyov D, Kerem E. Differences in disease expression between primary ciliary dyskinesia and cystic fibrosis with and without pancreatic insufficiency. Chest. 2014;145(4):738–44.CrossRef
Metadata
Title
Cost-effectiveness analysis of three algorithms for diagnosing primary ciliary dyskinesia: a simulation study
Authors
Panayiotis Kouis
Stefania I. Papatheodorou
Nicos Middleton
George Giallouros
Kyriacos Kyriacou
Joshua T. Cohen
John S. Evans
Panayiotis K. Yiallouros
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Orphanet Journal of Rare Diseases / Issue 1/2019
Electronic ISSN: 1750-1172
DOI
https://doi.org/10.1186/s13023-019-1116-3

Other articles of this Issue 1/2019

Orphanet Journal of Rare Diseases 1/2019 Go to the issue

Position statement

Rare diseases in Chile: challenges and recommendations in universal health coverage context

Research

Pilot experience of multidisciplinary team discussion dedicated to inherited pulmonary fibrosis

Research

Urea cycle disorders in Argentine patients: clinical presentation, biochemical and genetic findings

Research

The cumulative incidence and trends of rare diseases in South Korea: a nationwide study of the administrative data from the National Health Insurance Service database from 2011–2015

Research

Novel mutations and the ophthalmologic characters in Chinese patients with Wolfram Syndrome

Research

Evaluation of the frequency of non-motor symptoms of Parkinson’s disease in adult patients with Gaucher disease type 1