Skip to main content
Top
Published in: Journal of Digital Imaging 1/2016

01-02-2016

Feature-Motivated Simplified Adaptive PCNN-Based Medical Image Fusion Algorithm in NSST Domain

Authors: Padma Ganasala, Vinod Kumar

Published in: Journal of Imaging Informatics in Medicine | Issue 1/2016

Login to get access

Abstract

Multimodality medical image fusion plays a vital role in diagnosis, treatment planning, and follow-up studies of various diseases. It provides a composite image containing critical information of source images required for better localization and definition of different organs and lesions. In the state-of-the-art image fusion methods based on nonsubsampled shearlet transform (NSST) and pulse-coupled neural network (PCNN), authors have used normalized coefficient value to motivate the PCNN-processing both low-frequency (LF) and high-frequency (HF) sub-bands. This makes the fused image blurred and decreases its contrast. The main objective of this work is to design an image fusion method that gives the fused image with better contrast, more detail information, and suitable for clinical use. We propose a novel image fusion method utilizing feature-motivated adaptive PCNN in NSST domain for fusion of anatomical images. The basic PCNN model is simplified, and adaptive-linking strength is used. Different features are used to motivate the PCNN-processing LF and HF sub-bands. The proposed method is extended for fusion of functional image with an anatomical image in improved nonlinear intensity hue and saturation (INIHS) color model. Extensive fusion experiments have been performed on CT-MRI and SPECT-MRI datasets. Visual and quantitative analysis of experimental results proved that the proposed method provides satisfactory fusion outcome compared to other image fusion methods.
Literature
1.
go back to reference Paulino AC, Thorstad WL, Fox T: Role of fusion in radiotherapy treatment planning. Semin Nucl Med 33:238–243, 2003CrossRefPubMed Paulino AC, Thorstad WL, Fox T: Role of fusion in radiotherapy treatment planning. Semin Nucl Med 33:238–243, 2003CrossRefPubMed
2.
go back to reference Krempien RC, Daeuber S, Hensley FW, Wannenmacher M, Harms W: Image fusion of CT and MRI data enables improved target volume definition in 3D-brachytherapy treatment planning. Brachytherapy 2:164–171, 2003CrossRefPubMed Krempien RC, Daeuber S, Hensley FW, Wannenmacher M, Harms W: Image fusion of CT and MRI data enables improved target volume definition in 3D-brachytherapy treatment planning. Brachytherapy 2:164–171, 2003CrossRefPubMed
3.
go back to reference James AP, Dasarathy BV: Medical image fusion: a survey of the state of the art. Inf Fusion 19:4–19, 2014CrossRef James AP, Dasarathy BV: Medical image fusion: a survey of the state of the art. Inf Fusion 19:4–19, 2014CrossRef
4.
go back to reference Bai X, Gu S, Zhou F, Xue B: Weighted image fusion based on multi-scale top-hat transform: algorithms and a comparison study. Optik - Int J Light Electron Opt 124:1660–1668, 2013CrossRef Bai X, Gu S, Zhou F, Xue B: Weighted image fusion based on multi-scale top-hat transform: algorithms and a comparison study. Optik - Int J Light Electron Opt 124:1660–1668, 2013CrossRef
5.
go back to reference Kavitha CT, Chellamuthu C: Medical image fusion based on hybrid intelligence. Appl Soft Comput 20:83–94, 2014CrossRef Kavitha CT, Chellamuthu C: Medical image fusion based on hybrid intelligence. Appl Soft Comput 20:83–94, 2014CrossRef
6.
go back to reference Li M, Cai W, Tan Z: A region-based multi-sensor image fusion scheme using pulse-coupled neural network. Pattern Recogn. Lett. 27:1948–1956, 2006CrossRef Li M, Cai W, Tan Z: A region-based multi-sensor image fusion scheme using pulse-coupled neural network. Pattern Recogn. Lett. 27:1948–1956, 2006CrossRef
7.
go back to reference Virmani J, Kumar V, Kalra N, Khandelwal N: Neural network ensemble based CAD system for focal liver lesions from B-mode ultrasound. J Digit Imaging 27:520–537, 2014PubMedCentralCrossRefPubMed Virmani J, Kumar V, Kalra N, Khandelwal N: Neural network ensemble based CAD system for focal liver lesions from B-mode ultrasound. J Digit Imaging 27:520–537, 2014PubMedCentralCrossRefPubMed
9.
go back to reference He C, Liu Q, Li H, Wang H: Multimodal medical image fusion based on IHS and PCA. Procedia Eng 7:280–285, 2010CrossRef He C, Liu Q, Li H, Wang H: Multimodal medical image fusion based on IHS and PCA. Procedia Eng 7:280–285, 2010CrossRef
10.
go back to reference Baum KG, Schmidt E, Rafferty K, Krol A, Helguera M: Evaluation of novel genetic algorithm generated schemes for positron emission tomography (PET)/magnetic resonance imaging (MRI) image fusion. J Digit Imaging 24:1031–1043, 2011PubMedCentralCrossRefPubMed Baum KG, Schmidt E, Rafferty K, Krol A, Helguera M: Evaluation of novel genetic algorithm generated schemes for positron emission tomography (PET)/magnetic resonance imaging (MRI) image fusion. J Digit Imaging 24:1031–1043, 2011PubMedCentralCrossRefPubMed
12.
go back to reference Easley G, Labate D, Lim W-Q: Sparse directional image representations using the discrete shearlet transform. Appl. Comput. Harmon. Anal. 25:25–46, 2008CrossRef Easley G, Labate D, Lim W-Q: Sparse directional image representations using the discrete shearlet transform. Appl. Comput. Harmon. Anal. 25:25–46, 2008CrossRef
13.
15.
go back to reference Chen Y, Xiong J, Liu H-L, Fan Q: Fusion method of infrared and visible images based on neighborhood characteristic and regionalization in NSCT domain. Optik - Int J Light Electron Opt 125:4980–4984, 2014CrossRef Chen Y, Xiong J, Liu H-L, Fan Q: Fusion method of infrared and visible images based on neighborhood characteristic and regionalization in NSCT domain. Optik - Int J Light Electron Opt 125:4980–4984, 2014CrossRef
16.
go back to reference Kong W: Technique for gray-scale visual light and infrared image fusion based on nonsubsampled shearlet transform. Infrared Phys. Technol. 63:110–118, 2014CrossRef Kong W: Technique for gray-scale visual light and infrared image fusion based on nonsubsampled shearlet transform. Infrared Phys. Technol. 63:110–118, 2014CrossRef
18.
go back to reference Kong W, Liu J: Technique for image fusion based on NSST domain improved fast non-classical RF. Infrared Phys. Technol. 61:27–36, 2013CrossRef Kong W, Liu J: Technique for image fusion based on NSST domain improved fast non-classical RF. Infrared Phys. Technol. 61:27–36, 2013CrossRef
19.
go back to reference Wang Z, Ma Y, Cheng F, Yang L: Review of pulse-coupled neural networks. Image Vis. Comput. 28:5–13, 2010CrossRef Wang Z, Ma Y, Cheng F, Yang L: Review of pulse-coupled neural networks. Image Vis. Comput. 28:5–13, 2010CrossRef
20.
go back to reference Qu X-B, Yan J-W, Xiao H-Z, Zhu Z-Q: Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain. Acta Autom. Sin. 34:1508–1514, 2008CrossRef Qu X-B, Yan J-W, Xiao H-Z, Zhu Z-Q: Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain. Acta Autom. Sin. 34:1508–1514, 2008CrossRef
21.
go back to reference Das S, Kundu M: NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency. Med Biol Eng Comput 50:1105–1114, 2012CrossRefPubMed Das S, Kundu M: NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency. Med Biol Eng Comput 50:1105–1114, 2012CrossRefPubMed
22.
go back to reference Kong W, Zhang L, Lei Y: Novel fusion method for visible light and infrared images based on NSST–SF–PCNN. Infrared Phys. Technol. 65:103–112, 2014CrossRef Kong W, Zhang L, Lei Y: Novel fusion method for visible light and infrared images based on NSST–SF–PCNN. Infrared Phys. Technol. 65:103–112, 2014CrossRef
23.
go back to reference Kong W, Liu J: Technique for image fusion based on nonsubsampled shearlet transform and improved pulse-coupled neural network. OPTICE 52:017001, 2013CrossRef Kong W, Liu J: Technique for image fusion based on nonsubsampled shearlet transform and improved pulse-coupled neural network. OPTICE 52:017001, 2013CrossRef
24.
go back to reference Wang Z, Ma Y: Medical image fusion using m-PCNN. Inf Fusion 9:176–185, 2008CrossRef Wang Z, Ma Y: Medical image fusion using m-PCNN. Inf Fusion 9:176–185, 2008CrossRef
25.
go back to reference Baohua Z, Xiaoqi L, Weitao J: A multi-focus image fusion algorithm based on an improved dual-channel PCNN in NSCT domain. Optik - Int J Light Electron Opt 124:4104–4109, 2013CrossRef Baohua Z, Xiaoqi L, Weitao J: A multi-focus image fusion algorithm based on an improved dual-channel PCNN in NSCT domain. Optik - Int J Light Electron Opt 124:4104–4109, 2013CrossRef
26.
go back to reference Kong WW: Multi-sensor image fusion based on NSST domain I < sup > 2</sup > CM. Electron. Lett. 49:802–803, 2013CrossRef Kong WW: Multi-sensor image fusion based on NSST domain I < sup > 2</sup > CM. Electron. Lett. 49:802–803, 2013CrossRef
27.
go back to reference Wang N, Ma Y, Zhan K: Spiking cortical model for multifocus image fusion. Neurocomputing 130:44–51, 2014CrossRef Wang N, Ma Y, Zhan K: Spiking cortical model for multifocus image fusion. Neurocomputing 130:44–51, 2014CrossRef
28.
go back to reference Wang R, Wu Y, Ding M, Zhang X: Medical image fusion based on spiking cortical model. City Wang R, Wu Y, Ding M, Zhang X: Medical image fusion based on spiking cortical model. City
29.
go back to reference Wang QL: Nonseparable shearlet transform. IEEE Trans. Image Process. 22:2056–2065, 2013CrossRef Wang QL: Nonseparable shearlet transform. IEEE Trans. Image Process. 22:2056–2065, 2013CrossRef
30.
go back to reference Tu T-M, Su S-C, Shyu H-C, Huang PS: A new look at IHS-like image fusion methods. Inf Fusion 2:177–186, 2001CrossRef Tu T-M, Su S-C, Shyu H-C, Huang PS: A new look at IHS-like image fusion methods. Inf Fusion 2:177–186, 2001CrossRef
31.
go back to reference Bhatnagar G, Wu QMJ, Zheng L: Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans. Multimedia 15:1014–1024, 2013CrossRef Bhatnagar G, Wu QMJ, Zheng L: Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans. Multimedia 15:1014–1024, 2013CrossRef
32.
go back to reference Chun-Liang C, Wen-Hsiang T: Image fusion with no gamut problem by improved nonlinear IHS transforms for remote sensing. IEEE Trans. Geosci. Remote Sens. 52:651–663, 2014CrossRef Chun-Liang C, Wen-Hsiang T: Image fusion with no gamut problem by improved nonlinear IHS transforms for remote sensing. IEEE Trans. Geosci. Remote Sens. 52:651–663, 2014CrossRef
33.
go back to reference Xydeas CS, Petrović V: Objective image fusion performance measure. Electron. Lett. 36:308–309, 2000CrossRef Xydeas CS, Petrović V: Objective image fusion performance measure. Electron. Lett. 36:308–309, 2000CrossRef
34.
go back to reference Piella G, Heijmans H: A new quality metric for image fusion. Proc Image Processing, 2003 ICIP 2003 Proceedings 2003 International Conference on: City, 2003, 14–17 Piella G, Heijmans H: A new quality metric for image fusion. Proc Image Processing, 2003 ICIP 2003 Proceedings 2003 International Conference on: City, 2003, 14–17
35.
go back to reference Zhou W, Bovik AC: A universal image quality index. IEEE Signal Process Lett. 9:81–84, 2002CrossRef Zhou W, Bovik AC: A universal image quality index. IEEE Signal Process Lett. 9:81–84, 2002CrossRef
36.
go back to reference Myungjin C, Rae Young K, Myeong-Ryong N, Hong Oh K: Fusion of multispectral and panchromatic satellite images using the curvelet transform. IEEE Geosci Remote Sens Lett 2:136–140, 2005CrossRef Myungjin C, Rae Young K, Myeong-Ryong N, Hong Oh K: Fusion of multispectral and panchromatic satellite images using the curvelet transform. IEEE Geosci Remote Sens Lett 2:136–140, 2005CrossRef
Metadata
Title
Feature-Motivated Simplified Adaptive PCNN-Based Medical Image Fusion Algorithm in NSST Domain
Authors
Padma Ganasala
Vinod Kumar
Publication date
01-02-2016
Publisher
Springer US
Published in
Journal of Imaging Informatics in Medicine / Issue 1/2016
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-015-9806-4

Other articles of this Issue 1/2016

Journal of Digital Imaging 1/2016 Go to the issue