Skip to main content
Top
Published in: Abdominal Radiology 1/2023

23-09-2022 | Computed Tomography | Pancreas

Inter- and intra-observer variability of computed tomography-based parenchymal- and ductal diameters in chronic pancreatitis: a multi-observer international study

Authors: Jens Borgbjerg, Emily Steinkohl, Søren S. Olesen, Fatih Akisik, Anne Bethke, Edita Bieliuniene, Heidi S. Christensen, Trond Engjom, Ingfrid S. Haldorsen, Nikolaos Kartalis, Maria V. Lisitskaya, Gintare Naujokaite, Srdan Novovic, Imanta Ozola-Zālīte, Anna E. Phillips, Jordan K. Swensson, Asbjørn M. Drewes, Jens B. Frøkjær

Published in: Abdominal Radiology | Issue 1/2023

Login to get access

Abstract

Purpose

The need for incorporation of quantitative imaging biomarkers of pancreatic parenchymal and ductal structures has been highlighted in recent proposals for new scoring systems in chronic pancreatitis (CP). To quantify inter- and intra-observer variability in CT-based measurements of ductal- and gland diameters in CP patients.

Materials and Methods

Prospectively acquired pancreatic CT examinations from 50 CP patients were reviewed by 12 radiologists and four pancreatologists from 10 institutions. Assessment entailed measuring maximum diameter in the axial plane of four structures: (1) pancreatic head (PDhead), (2) pancreatic body (PDbody), (3) main pancreatic duct in the pancreatic head (MPDhead), and (4) body (MPDbody). Agreement was assessed by the 95% limits of agreement with the mean (LOAM), representing how much a single measurement for a specific subject may plausibly deviate from the mean of all measurements on the specific subject. Bland–Altman limits of agreement (LoA) were generated for intra-observer pairs.

Results

The 16 observers completed 6400 caliper placements comprising a first and second measurement session. The widest inter-observer LOAM was seen with PDhead (± 9.1 mm), followed by PDbody (± 5.1 mm), MPDhead (± 3.2 mm), and MPDbody (± 2.6 mm), whereas the mean intra-observer LoA width was ± 7.3, ± 5.1, ± 3.7, and ± 2.4 mm, respectively.

Conclusion

Substantial intra- and inter-observer variability was observed in pancreatic two-point measurements. This was especially pronounced for parenchymal and duct diameters of the pancreatic head. These findings challenge the implementation of two-point measurements as the foundation for quantitative imaging scoring systems in CP.

Graphical abstract

Appendix
Available only for authorised users
Literature
1.
go back to reference Muniraj, T., Aslanian, H. R., Farrell, J. & Jamidar, P. A. Chronic pancreatitis, a comprehensive review and update. Part I: epidemiology, etiology, risk factors, genetics, pathophysiology, and clinical features. Dis. Mon. 60, 530–550 (2014). Muniraj, T., Aslanian, H. R., Farrell, J. & Jamidar, P. A. Chronic pancreatitis, a comprehensive review and update. Part I: epidemiology, etiology, risk factors, genetics, pathophysiology, and clinical features. Dis. Mon. 60, 530–550 (2014).
2.
go back to reference Conwell, D. L. et al. American Pancreatic Association Practice Guidelines in Chronic Pancreatitis: evidence-based report on diagnostic guidelines. Pancreas 43, 1143–1162 (2014).CrossRef Conwell, D. L. et al. American Pancreatic Association Practice Guidelines in Chronic Pancreatitis: evidence-based report on diagnostic guidelines. Pancreas 43, 1143–1162 (2014).CrossRef
3.
go back to reference Frøkjær, J. B. et al. Guidelines for the Diagnostic Cross Sectional Imaging and Severity Scoring of Chronic Pancreatitis. Pancreatology 18, 764–773 (2018).CrossRef Frøkjær, J. B. et al. Guidelines for the Diagnostic Cross Sectional Imaging and Severity Scoring of Chronic Pancreatitis. Pancreatology 18, 764–773 (2018).CrossRef
4.
go back to reference Tirkes, T. et al. Reporting Standards for Chronic Pancreatitis by Using CT, MRI, and MR Cholangiopancreatography: The Consortium for the Study of Chronic Pancreatitis, Diabetes, and Pancreatic Cancer. Radiology 290, 207–215 (2019).CrossRef Tirkes, T. et al. Reporting Standards for Chronic Pancreatitis by Using CT, MRI, and MR Cholangiopancreatography: The Consortium for the Study of Chronic Pancreatitis, Diabetes, and Pancreatic Cancer. Radiology 290, 207–215 (2019).CrossRef
5.
go back to reference Dasyam, A. K., Shah, Z. K., Tirkes, T., Dasyam, N. & Borhani, A. A. Cross-sectional imaging-based severity scoring of chronic pancreatitis: why it is necessary and how it can be done. Abdom Radiol (NY) 45, 1447–1457 (2020).CrossRef Dasyam, A. K., Shah, Z. K., Tirkes, T., Dasyam, N. & Borhani, A. A. Cross-sectional imaging-based severity scoring of chronic pancreatitis: why it is necessary and how it can be done. Abdom Radiol (NY) 45, 1447–1457 (2020).CrossRef
6.
go back to reference Sarner, M. & Cotton, P. B. Classification of pancreatitis. Gut 25, 756–759 (1984).CrossRef Sarner, M. & Cotton, P. B. Classification of pancreatitis. Gut 25, 756–759 (1984).CrossRef
7.
go back to reference Whitcomb, D. C. et al. Chronic pancreatitis: An international draft consensus proposal for a new mechanistic definition. Pancreatology 16, 218–224 (2016).CrossRef Whitcomb, D. C. et al. Chronic pancreatitis: An international draft consensus proposal for a new mechanistic definition. Pancreatology 16, 218–224 (2016).CrossRef
8.
go back to reference Kumar, H., DeSouza, S. V. & Petrov, M. S. Automated pancreas segmentation from computed tomography and magnetic resonance images: A systematic review. Comput. Methods Programs Biomed. 178, 319–328 (2019).CrossRef Kumar, H., DeSouza, S. V. & Petrov, M. S. Automated pancreas segmentation from computed tomography and magnetic resonance images: A systematic review. Comput. Methods Programs Biomed. 178, 319–328 (2019).CrossRef
9.
go back to reference Steinkohl, E. et al. Progression of parenchymal and ductal findings in patients with chronic pancreatitis: A 4-year follow-up MRI study. Eur. J. Radiol. 125, 108868 (2020).CrossRef Steinkohl, E. et al. Progression of parenchymal and ductal findings in patients with chronic pancreatitis: A 4-year follow-up MRI study. Eur. J. Radiol. 125, 108868 (2020).CrossRef
10.
go back to reference Kipp, J. P. et al. Normal pancreatic volume in adults is influenced by visceral fat, vertebral body width and age. Abdominal Radiology vol. 44 958–966 (2019).CrossRef Kipp, J. P. et al. Normal pancreatic volume in adults is influenced by visceral fat, vertebral body width and age. Abdominal Radiology vol. 44 958–966 (2019).CrossRef
11.
go back to reference Lisitskaya, M. V. et al. Systematic approach for assessment of imaging features in chronic pancreatitis: a feasibility and validation study from the Scandinavian Baltic Pancreatic Club (SBPC) database. Abdom Radiol (NY) 45, 1468–1480 (2020).CrossRef Lisitskaya, M. V. et al. Systematic approach for assessment of imaging features in chronic pancreatitis: a feasibility and validation study from the Scandinavian Baltic Pancreatic Club (SBPC) database. Abdom Radiol (NY) 45, 1468–1480 (2020).CrossRef
12.
go back to reference Razek, A. A. K. A., Elfar, E. & Abubacker, S. Interobserver agreement of computed tomography reporting standards for chronic pancreatitis. Abdom Radiol (NY) 44, 2459–2465 (2019).CrossRef Razek, A. A. K. A., Elfar, E. & Abubacker, S. Interobserver agreement of computed tomography reporting standards for chronic pancreatitis. Abdom Radiol (NY) 44, 2459–2465 (2019).CrossRef
13.
go back to reference Olesen, S. S., Laukkarinen, J., Drewes, A. M. & Nojgaard, C. The Scandinavian Baltic Pancreatic Club (SBPC) Database: Design, Rationale and Characterisation of the Study Cohort. Pancreatology vol. 17 S58 (2017).CrossRef Olesen, S. S., Laukkarinen, J., Drewes, A. M. & Nojgaard, C. The Scandinavian Baltic Pancreatic Club (SBPC) Database: Design, Rationale and Characterisation of the Study Cohort. Pancreatology vol. 17 S58 (2017).CrossRef
14.
go back to reference Schneider, A., Löhr, J. M. & Singer, M. V. The M-ANNHEIM classification of chronic pancreatitis: introduction of a unifying classification system based on a review of previous classifications of the disease. J. Gastroenterol. 42, 101–119 (2007).CrossRef Schneider, A., Löhr, J. M. & Singer, M. V. The M-ANNHEIM classification of chronic pancreatitis: introduction of a unifying classification system based on a review of previous classifications of the disease. J. Gastroenterol. 42, 101–119 (2007).CrossRef
16.
go back to reference Borgbjerg, J. MULRECON: A Web-based Imaging Viewer for Visualization of Volumetric Images. Curr. Probl. Diagn. Radiol. 48, 531–534 (2019).CrossRef Borgbjerg, J. MULRECON: A Web-based Imaging Viewer for Visualization of Volumetric Images. Curr. Probl. Diagn. Radiol. 48, 531–534 (2019).CrossRef
17.
go back to reference Borgbjerg, J. Web-based imaging viewer for real-color volumetric reconstruction of human visible project and DICOM datasets. Clin. Anat. 34, 470–477 (2021).CrossRef Borgbjerg, J. Web-based imaging viewer for real-color volumetric reconstruction of human visible project and DICOM datasets. Clin. Anat. 34, 470–477 (2021).CrossRef
18.
go back to reference Christensen, H. S., Borgbjerg, J., Børty, L. & Bøgsted, M. On Jones et al.’s method for extending Bland-Altman plots to limits of agreement with the mean for multiple observers. BMC Med. Res. Methodol. 20, 304 (2020).CrossRef Christensen, H. S., Borgbjerg, J., Børty, L. & Bøgsted, M. On Jones et al.’s method for extending Bland-Altman plots to limits of agreement with the mean for multiple observers. BMC Med. Res. Methodol. 20, 304 (2020).CrossRef
19.
go back to reference McGraw, K. O. & Wong, S. P. Forming inferences about some intraclass correlation coefficients. Psychological Methods vol. 1 30–46 (1996).CrossRef McGraw, K. O. & Wong, S. P. Forming inferences about some intraclass correlation coefficients. Psychological Methods vol. 1 30–46 (1996).CrossRef
20.
go back to reference Cohen, J. Statistical Power Analysis for the Behavioral Sciences. (Routledge, 2013). Cohen, J. Statistical Power Analysis for the Behavioral Sciences. (Routledge, 2013).
21.
go back to reference deSouza, N. M. et al. Validated imaging biomarkers as decision-making tools in clinical trials and routine practice: current status and recommendations from the EIBALL* subcommittee of the European Society of Radiology (ESR). Insights Imaging 10, 87 (2019).CrossRef deSouza, N. M. et al. Validated imaging biomarkers as decision-making tools in clinical trials and routine practice: current status and recommendations from the EIBALL* subcommittee of the European Society of Radiology (ESR). Insights Imaging 10, 87 (2019).CrossRef
22.
go back to reference Farzin, B. et al. Agreement studies in radiology research. Diagn. Interv. Imaging 98, 227–233 (2017).CrossRef Farzin, B. et al. Agreement studies in radiology research. Diagn. Interv. Imaging 98, 227–233 (2017).CrossRef
23.
go back to reference Trout, A. T. et al. Interobserver Agreement for CT and MRI Findings of Chronic Pancreatitis in Children: A Multicenter Ancillary Study Under the INSPPIRE Consortium. AJR Am. J. Roentgenol. 1–11 (2022). Trout, A. T. et al. Interobserver Agreement for CT and MRI Findings of Chronic Pancreatitis in Children: A Multicenter Ancillary Study Under the INSPPIRE Consortium. AJR Am. J. Roentgenol. 1–11 (2022).
24.
go back to reference Trout, A. T. et al. Normal pancreatic parenchymal thickness by CT in healthy children. Pediatr. Radiol. 48, 1600–1605 (2018).CrossRef Trout, A. T. et al. Normal pancreatic parenchymal thickness by CT in healthy children. Pediatr. Radiol. 48, 1600–1605 (2018).CrossRef
25.
go back to reference Bankier, A. A., Levine, D., Halpern, E. F. & Kressel, H. Y. Consensus Interpretation in Imaging Research: Is There a Better Way? Radiology vol. 257 14–17 (2010).CrossRef Bankier, A. A., Levine, D., Halpern, E. F. & Kressel, H. Y. Consensus Interpretation in Imaging Research: Is There a Better Way? Radiology vol. 257 14–17 (2010).CrossRef
26.
go back to reference McNitt-Gray, M. F. et al. Determining the Variability of Lesion Size Measurements from CT Patient Data Sets Acquired under ‘No Change’ Conditions. Translational Oncology vol. 8 55–64 (2015).CrossRef McNitt-Gray, M. F. et al. Determining the Variability of Lesion Size Measurements from CT Patient Data Sets Acquired under ‘No Change’ Conditions. Translational Oncology vol. 8 55–64 (2015).CrossRef
27.
go back to reference Bankier, A. A. et al. Recommendations for Measuring Pulmonary Nodules at CT: A Statement from the Fleischner Society. Radiology 285, 584–600 (2017).CrossRef Bankier, A. A. et al. Recommendations for Measuring Pulmonary Nodules at CT: A Statement from the Fleischner Society. Radiology 285, 584–600 (2017).CrossRef
28.
go back to reference Anaizi, A., Hart, P. A. & Conwell, D. L. Diagnosing Chronic Pancreatitis. Dig. Dis. Sci. 62, 1713–1720 (2017).CrossRef Anaizi, A., Hart, P. A. & Conwell, D. L. Diagnosing Chronic Pancreatitis. Dig. Dis. Sci. 62, 1713–1720 (2017).CrossRef
Metadata
Title
Inter- and intra-observer variability of computed tomography-based parenchymal- and ductal diameters in chronic pancreatitis: a multi-observer international study
Authors
Jens Borgbjerg
Emily Steinkohl
Søren S. Olesen
Fatih Akisik
Anne Bethke
Edita Bieliuniene
Heidi S. Christensen
Trond Engjom
Ingfrid S. Haldorsen
Nikolaos Kartalis
Maria V. Lisitskaya
Gintare Naujokaite
Srdan Novovic
Imanta Ozola-Zālīte
Anna E. Phillips
Jordan K. Swensson
Asbjørn M. Drewes
Jens B. Frøkjær
Publication date
23-09-2022
Publisher
Springer US
Published in
Abdominal Radiology / Issue 1/2023
Print ISSN: 2366-004X
Electronic ISSN: 2366-0058
DOI
https://doi.org/10.1007/s00261-022-03667-2

Other articles of this Issue 1/2023

Abdominal Radiology 1/2023 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.