Skip to main content
Top
Published in: Journal of Digital Imaging 2/2016

Open Access 01-04-2016

User Interaction in Semi-Automatic Segmentation of Organs at Risk: a Case Study in Radiotherapy

Authors: Anjana Ramkumar, Jose Dolz, Hortense A. Kirisli, Sonja Adebahr, Tanja Schimek-Jasch, Ursula Nestle, Laurent Massoptier, Edit Varga, Pieter Jan Stappers, Wiro J. Niessen, Yu Song

Published in: Journal of Imaging Informatics in Medicine | Issue 2/2016

Login to get access

Abstract

Accurate segmentation of organs at risk is an important step in radiotherapy planning. Manual segmentation being a tedious procedure and prone to inter- and intra-observer variability, there is a growing interest in automated segmentation methods. However, automatic methods frequently fail to provide satisfactory result, and post-processing corrections are often needed. Semi-automatic segmentation methods are designed to overcome these problems by combining physicians’ expertise and computers’ potential. This study evaluates two semi-automatic segmentation methods with different types of user interactions, named the “strokes” and the “contour”, to provide insights into the role and impact of human-computer interaction. Two physicians participated in the experiment. In total, 42 case studies were carried out on five different types of organs at risk. For each case study, both the human-computer interaction process and quality of the segmentation results were measured subjectively and objectively. Furthermore, different measures of the process and the results were correlated. A total of 36 quantifiable and ten non-quantifiable correlations were identified for each type of interaction. Among those pairs of measures, 20 of the contour method and 22 of the strokes method were strongly or moderately correlated, either directly or inversely. Based on those correlated measures, it is concluded that: (1) in the design of semi-automatic segmentation methods, user interactions need to be less cognitively challenging; (2) based on the observed workflows and preferences of physicians, there is a need for flexibility in the interface design; (3) the correlated measures provide insights that can be used in improving user interaction design.
Literature
1.
go back to reference Burnet NG, Thomas SJ, Burton KE, Jefferies SJ: Defining the tumour and target volumes for radiotherapy. Cancer Imaging: Off Publ Int Cancer Imaging Soc 4(2):153–61, 2004CrossRef Burnet NG, Thomas SJ, Burton KE, Jefferies SJ: Defining the tumour and target volumes for radiotherapy. Cancer Imaging: Off Publ Int Cancer Imaging Soc 4(2):153–61, 2004CrossRef
2.
go back to reference Moltz JH, Braunewell S, Ruhaak J, et al.: Analysis of variability in manual liver tumor delineation in CT scans, IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 1974–1977, 2011 Moltz JH, Braunewell S, Ruhaak J, et al.: Analysis of variability in manual liver tumor delineation in CT scans, IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 1974–1977, 2011
3.
go back to reference Whitfield GA, Price P, Price GJ, Moore CJ: Automated delineation of radiotherapy volumes: are we going in the right direction? Br J Radiol 86(1021):20110718, 2013CrossRefPubMedPubMedCentral Whitfield GA, Price P, Price GJ, Moore CJ: Automated delineation of radiotherapy volumes: are we going in the right direction? Br J Radiol 86(1021):20110718, 2013CrossRefPubMedPubMedCentral
4.
go back to reference Heckel F, Moltz JH, Tietjen C, Hahn HK: Sketch-Based Editing Tools for Tumour Segmentation in 3D Medical Images. Comput Graphics Forum 32(8):144–157, 2013CrossRef Heckel F, Moltz JH, Tietjen C, Hahn HK: Sketch-Based Editing Tools for Tumour Segmentation in 3D Medical Images. Comput Graphics Forum 32(8):144–157, 2013CrossRef
5.
go back to reference Isambert A, Dhermain F, Bidault F, et al: Evaluation of an atlas-based automatic segmentation software for the delineation of brain organs at risk in a radiation therapy clinical context. Radiother Oncol 87(1):93–99, 2008CrossRefPubMed Isambert A, Dhermain F, Bidault F, et al: Evaluation of an atlas-based automatic segmentation software for the delineation of brain organs at risk in a radiation therapy clinical context. Radiother Oncol 87(1):93–99, 2008CrossRefPubMed
6.
go back to reference Wu K, Ung YC, Hwang D, et al: Auto-contouring and manual contouring: which is the better method for target delineation using 18F-FDG PET/CT in non-small cell lung cancer? J Nucl Med 51(10):1517–23, 2010CrossRefPubMed Wu K, Ung YC, Hwang D, et al: Auto-contouring and manual contouring: which is the better method for target delineation using 18F-FDG PET/CT in non-small cell lung cancer? J Nucl Med 51(10):1517–23, 2010CrossRefPubMed
7.
go back to reference Smith CM, Smith J, Williams SK, Rodriguez JJ, Hoying JB: Automatic thresholding of three-dimensional microvascular structures from confocal microscopy images. J Microsc 225(3):244–257, 2007CrossRefPubMed Smith CM, Smith J, Williams SK, Rodriguez JJ, Hoying JB: Automatic thresholding of three-dimensional microvascular structures from confocal microscopy images. J Microsc 225(3):244–257, 2007CrossRefPubMed
8.
go back to reference Grau V, Mewes AUJ, Alcaniz M, Kikinis R, Warfield SK: Improved watershed transform for medical image segmentation using prior information. IEEE Trans Med Imaging 23(4):447–458, 2004CrossRefPubMed Grau V, Mewes AUJ, Alcaniz M, Kikinis R, Warfield SK: Improved watershed transform for medical image segmentation using prior information. IEEE Trans Med Imaging 23(4):447–458, 2004CrossRefPubMed
9.
go back to reference Mondal T, Jain A, Sardana HK: Automatic craniofacial structure detection on cephalometric images. IEEE Trans Image Process 20(9):2606–2614, 2011CrossRefPubMed Mondal T, Jain A, Sardana HK: Automatic craniofacial structure detection on cephalometric images. IEEE Trans Image Process 20(9):2606–2614, 2011CrossRefPubMed
10.
go back to reference Jin Y, Angelini E, Laine A: Wavelets in medical image processing: denoising, segmentation, and registration. Handbook 832 of biomedical image analysis, Kluwer Academic/Plenum Publishers, New York, Vol.1, Segmentation Models, Chapter 6:305–358, 2005 Jin Y, Angelini E, Laine A: Wavelets in medical image processing: denoising, segmentation, and registration. Handbook 832 of biomedical image analysis, Kluwer Academic/Plenum Publishers, New York, Vol.1, Segmentation Models, Chapter 6:305–358, 2005
11.
go back to reference Sims R, Isambert A, Grégoire V, et al: A pre-clinical assessment of an atlas-based automatic segmentation tool for the head and neck. Radiother Oncol 93(3):474–478, 2009CrossRefPubMed Sims R, Isambert A, Grégoire V, et al: A pre-clinical assessment of an atlas-based automatic segmentation tool for the head and neck. Radiother Oncol 93(3):474–478, 2009CrossRefPubMed
12.
go back to reference Boykov Y, Jolly MP: Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. Proc. IEEE Int. Conf. Comput. Vis., 105–112, 2001 Boykov Y, Jolly MP: Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. Proc. IEEE Int. Conf. Comput. Vis., 105–112, 2001
13.
go back to reference Yeo SY, Xie X, Sazonov I, Nithiarasu P: Geometrically induced force interaction for three-dimensional deformable models. IEEE Trans Image Process 20(5):1373–1387, 2011CrossRefPubMed Yeo SY, Xie X, Sazonov I, Nithiarasu P: Geometrically induced force interaction for three-dimensional deformable models. IEEE Trans Image Process 20(5):1373–1387, 2011CrossRefPubMed
14.
go back to reference Lee N, Smith RT, Laine AF: Interactive segmentation for geographic atrophy in retinal fundus images, Proc. 42nd Asilomar Conf. Signals, Systems and Computers, 655–658, 2008 Lee N, Smith RT, Laine AF: Interactive segmentation for geographic atrophy in retinal fundus images, Proc. 42nd Asilomar Conf. Signals, Systems and Computers, 655–658, 2008
16.
go back to reference Olabarriaga S, Smeulders A: Interaction in the segmentation of medical images: A survey. Med Image Anal 5(2):127–142, 2001CrossRefPubMed Olabarriaga S, Smeulders A: Interaction in the segmentation of medical images: A survey. Med Image Anal 5(2):127–142, 2001CrossRefPubMed
17.
go back to reference Karray F, Alemzadeh M, Saleh JA, Arab MN: Human-Computer Interaction: Overview on State of the Art, 1(1):137–159,2008 Karray F, Alemzadeh M, Saleh JA, Arab MN: Human-Computer Interaction: Overview on State of the Art, 1(1):137–159,2008
18.
go back to reference Blake A, Rother C, Brown M, Perez P, and Torr P: Interactive image segmentation using an adaptive gmmrf model, European Conference on Computer Vision (ECCV), 428–441, 2004 Blake A, Rother C, Brown M, Perez P, and Torr P: Interactive image segmentation using an adaptive gmmrf model, European Conference on Computer Vision (ECCV), 428–441, 2004
19.
go back to reference Yang W, Cai J, Member S, Zheng J, Luo J: User-friendly Interactive Image Segmentation through Unified Combinatorial User Inputs(c), 1–10, 2010 Yang W, Cai J, Member S, Zheng J, Luo J: User-friendly Interactive Image Segmentation through Unified Combinatorial User Inputs(c), 1–10, 2010
20.
go back to reference Harders M, Member S, Székely G, Member A: Enhancing Human–Computer Interaction in Medical Segmentation, Proceedings of the IEEE, 91(9), 2003 Harders M, Member S, Székely G, Member A: Enhancing Human–Computer Interaction in Medical Segmentation, Proceedings of the IEEE, 91(9), 2003
21.
go back to reference Heckel F, Moltz JH, Tietjen C, Hahn HK: Sketch-Based Editing Tools for Tumour Segmentation in 3D Medical Images. Comput Graphics Forum 32(8):144–157, 2013CrossRef Heckel F, Moltz JH, Tietjen C, Hahn HK: Sketch-Based Editing Tools for Tumour Segmentation in 3D Medical Images. Comput Graphics Forum 32(8):144–157, 2013CrossRef
22.
go back to reference Barret WA, Mortensen EN: Fast, accurate, and reproducible live wire boundary extraction. Vis. Biomedical Computing, 183–192,1996 Barret WA, Mortensen EN: Fast, accurate, and reproducible live wire boundary extraction. Vis. Biomedical Computing, 183–192,1996
23.
go back to reference Sherbondy AJ, Holmlund D, Rubin GD, Schraedley PK, Winograd T, Napel S: Alternative input devices for efficient navigation of large CT angiography data sets. Radiology 234:391–398, 2005CrossRefPubMed Sherbondy AJ, Holmlund D, Rubin GD, Schraedley PK, Winograd T, Napel S: Alternative input devices for efficient navigation of large CT angiography data sets. Radiology 234:391–398, 2005CrossRefPubMed
24.
go back to reference Sadeghi GHHM, Tien G and Atkins MS: Hands-free interactive image segmentation using eyegaze. SPIE Medical Imaging conference, 2009 Sadeghi GHHM, Tien G and Atkins MS: Hands-free interactive image segmentation using eyegaze. SPIE Medical Imaging conference, 2009
26.
go back to reference Li Y, Sun J, Tang CK, Shum HY: Lazy snapping. ACM Trans Graph 23(3):303–308, 2004CrossRef Li Y, Sun J, Tang CK, Shum HY: Lazy snapping. ACM Trans Graph 23(3):303–308, 2004CrossRef
27.
go back to reference Yang W, Cai J: User-friendly Interactive Image Segmentation through Unified Combinatorial User Inputs. IEEE Trans Image Process 19(9):2470–2479, 2010CrossRefPubMed Yang W, Cai J: User-friendly Interactive Image Segmentation through Unified Combinatorial User Inputs. IEEE Trans Image Process 19(9):2470–2479, 2010CrossRefPubMed
28.
go back to reference Hebbalaguppe R, McGuinness K, Kuklyte J, Healy G, O’Connor N and Smeaton A: User-Centered Computer Vision (UCCV), 1st IEEE Workshop on, 19–24, 2013 Hebbalaguppe R, McGuinness K, Kuklyte J, Healy G, O’Connor N and Smeaton A: User-Centered Computer Vision (UCCV), 1st IEEE Workshop on, 19–24, 2013
29.
go back to reference Dalah EZ, Nisbet A, Bradley D: Effect of window level on target volume delineation in treatment planning. Appl Radiat Isot 68:602–604, 2010CrossRefPubMed Dalah EZ, Nisbet A, Bradley D: Effect of window level on target volume delineation in treatment planning. Appl Radiat Isot 68:602–604, 2010CrossRefPubMed
30.
go back to reference Chun H, Kwak H, Eom YH, Ahn YY, Moon S, and Jeong H: Comparison of online social relations in volume vs interaction: a case study of cyworld, Proceeding of the 8th Internet Measurement Conference (IMC’08), 2008 Chun H, Kwak H, Eom YH, Ahn YY, Moon S, and Jeong H: Comparison of online social relations in volume vs interaction: a case study of cyworld, Proceeding of the 8th Internet Measurement Conference (IMC’08), 2008
31.
go back to reference Viswanath B, Mislove A, Cha M, Gummadi KP: On the evolution of user interaction in Facebook, The Second ACM SIGCOMM Workshop on Online Social Networks (WOSN’09), 2009 Viswanath B, Mislove A, Cha M, Gummadi KP: On the evolution of user interaction in Facebook, The Second ACM SIGCOMM Workshop on Online Social Networks (WOSN’09), 2009
32.
go back to reference Ju W, Leifer L: The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious. Des Issues 24(3):72–84, 2008CrossRef Ju W, Leifer L: The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious. Des Issues 24(3):72–84, 2008CrossRef
33.
go back to reference ISO/IEC, 9241–11: Ergonomic requirements for office work with visual display terminals (VDT)s - Part 11 Guidance on usability, ISO/IEC 9241–11, 1998 ISO/IEC, 9241–11: Ergonomic requirements for office work with visual display terminals (VDT)s - Part 11 Guidance on usability, ISO/IEC 9241–11, 1998
34.
go back to reference Nielsen J, Molich R: Heuristic evaluation of user interfaces, Proc. ACM CHI'90 Conference, 249–256, 1990 Nielsen J, Molich R: Heuristic evaluation of user interfaces, Proc. ACM CHI'90 Conference, 249–256, 1990
35.
go back to reference Liu Y, Osvalder AL, Dahlman S: Exploring user background settings in cognitive walkthrough evaluation of medical prototype interfaces: a case study, International Journal of Industrial Ergonomics, 2005 Liu Y, Osvalder AL, Dahlman S: Exploring user background settings in cognitive walkthrough evaluation of medical prototype interfaces: a case study, International Journal of Industrial Ergonomics, 2005
36.
go back to reference Clark RE, Pugh CM, Yates KA, Inaba K, Green DJ, Sullivan ME: The Use of Cognitive Task Analysis to Improve Instructional Descriptions of Procedures. J Surg Res 173(1):e37–e42, 2012CrossRefPubMed Clark RE, Pugh CM, Yates KA, Inaba K, Green DJ, Sullivan ME: The Use of Cognitive Task Analysis to Improve Instructional Descriptions of Procedures. J Surg Res 173(1):e37–e42, 2012CrossRefPubMed
37.
go back to reference Jaspers MW, Steen T, van den Bos C, Geenen M: The think aloud method: a guide to user interface design. Int J Med Inform 73(11–12):781–795, 2004CrossRefPubMed Jaspers MW, Steen T, van den Bos C, Geenen M: The think aloud method: a guide to user interface design. Int J Med Inform 73(11–12):781–795, 2004CrossRefPubMed
38.
go back to reference Lee S, Koubek RJ: The effects of usability and web design attributes on user preference for e-commerce web sites. J Comput Ind 61(4):329–341, 2010CrossRef Lee S, Koubek RJ: The effects of usability and web design attributes on user preference for e-commerce web sites. J Comput Ind 61(4):329–341, 2010CrossRef
39.
go back to reference Coen RN: Human-computer interaction in radiotherapy target volume delineation: a prospective, multi-institutional comparison of user input devices. J Digit Imaging 24(5):794–803, 2011CrossRef Coen RN: Human-computer interaction in radiotherapy target volume delineation: a prospective, multi-institutional comparison of user input devices. J Digit Imaging 24(5):794–803, 2011CrossRef
40.
go back to reference Kotani K, Horii K: An analysis of muscular load and performance in using a pen–tablet system. J Physiol Anthropol 22:89–95, 2003CrossRef Kotani K, Horii K: An analysis of muscular load and performance in using a pen–tablet system. J Physiol Anthropol 22:89–95, 2003CrossRef
41.
go back to reference McGuinness K, O’Connor NE: A comparative evaluation of interactive segmentation algorithms. Pattern Recogn 43(2):434–444, 2010CrossRef McGuinness K, O’Connor NE: A comparative evaluation of interactive segmentation algorithms. Pattern Recogn 43(2):434–444, 2010CrossRef
43.
go back to reference Balakrishnan R, Baudel T, Kurtenbach G, and Fitzmaurice GW: “The rockin’mouse: Integral 3D manipulation on a plane,” Proc. Conf. Human Factors Computing Systems, 311–318, 1997 Balakrishnan R, Baudel T, Kurtenbach G, and Fitzmaurice GW: “The rockin’mouse: Integral 3D manipulation on a plane,” Proc. Conf. Human Factors Computing Systems, 311–318, 1997
44.
go back to reference Hornbæk K: Current practice in measuring usability: Challenges to usability studies and research. Int J Hum-Comput Stud 64(2):79–102, 2006CrossRef Hornbæk K: Current practice in measuring usability: Challenges to usability studies and research. Int J Hum-Comput Stud 64(2):79–102, 2006CrossRef
46.
go back to reference Dolz J, Kirisli HA, Viard R, Massoptier L: Combining watershed and graph cuts methods to segment organs at risk in radiotherapy, Proc. SPIE 9034, Medical Imaging: Image Processing, 2014 Dolz J, Kirisli HA, Viard R, Massoptier L: Combining watershed and graph cuts methods to segment organs at risk in radiotherapy, Proc. SPIE 9034, Medical Imaging: Image Processing, 2014
47.
go back to reference Dolz J, Kirisli HA, Viard R, Massoptier L: Interactive approach to segment organs at risk in radiotherapy treatment planning, Proc. SPIE 9034, Medical Imaging: Image Processing, 2014 Dolz J, Kirisli HA, Viard R, Massoptier L: Interactive approach to segment organs at risk in radiotherapy treatment planning, Proc. SPIE 9034, Medical Imaging: Image Processing, 2014
48.
go back to reference Ramkumar A, Dolz J, Kirisli HA, et al.: Human-computer interaction in segmenting organs at risk for radiotherapy: a pilot study. Multimodal imaging towards individualized radiotherapy treatments, 69–79, ISBN: 978-94-6186-309-6, 2014 Ramkumar A, Dolz J, Kirisli HA, et al.: Human-computer interaction in segmenting organs at risk for radiotherapy: a pilot study. Multimodal imaging towards individualized radiotherapy treatments, 69–79, ISBN: 978-94-6186-309-6, 2014
50.
go back to reference Hart SG, Staveland LE: Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research, in: Hancock, P.A. and Meshkati, N. (Eds.) Human Mental Workload, North-Holland, 1998 Hart SG, Staveland LE: Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research, in: Hancock, P.A. and Meshkati, N. (Eds.) Human Mental Workload, North-Holland, 1998
51.
go back to reference Dice LR: Measures of the amount of ecologic association between species. Ecology 26(3):297–302, 1945CrossRef Dice LR: Measures of the amount of ecologic association between species. Ecology 26(3):297–302, 1945CrossRef
52.
go back to reference Dancey C, Reidy J: Statistics without Maths for Psychology: using SPSS for Windows. Prentice Hall, London, 2004 Dancey C, Reidy J: Statistics without Maths for Psychology: using SPSS for Windows. Prentice Hall, London, 2004
53.
go back to reference Freudenthal A, Stüdeli T, Lamata P, Samset E: Collaborative co-design of emerging multi-technologies for surgery. J Biomed Inform 44(2):198–215, 2011CrossRefPubMed Freudenthal A, Stüdeli T, Lamata P, Samset E: Collaborative co-design of emerging multi-technologies for surgery. J Biomed Inform 44(2):198–215, 2011CrossRefPubMed
54.
go back to reference Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D: Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simulation in Healthcare . J Soc Simul Healthcare 5(5):267–71, 2010CrossRef Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D: Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simulation in Healthcare . J Soc Simul Healthcare 5(5):267–71, 2010CrossRef
Metadata
Title
User Interaction in Semi-Automatic Segmentation of Organs at Risk: a Case Study in Radiotherapy
Authors
Anjana Ramkumar
Jose Dolz
Hortense A. Kirisli
Sonja Adebahr
Tanja Schimek-Jasch
Ursula Nestle
Laurent Massoptier
Edit Varga
Pieter Jan Stappers
Wiro J. Niessen
Yu Song
Publication date
01-04-2016
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 2/2016
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-015-9839-8

Other articles of this Issue 2/2016

Journal of Digital Imaging 2/2016 Go to the issue