Abstract

Major technical constraints like minimum data storage at satellite platform in space, less bandwidth for communication with earth station, etc. limits the satellite sensors from capturing images with high spatial and high spectral resolutions simultaneously. To overcome this limitation, image fusion has proved to be a potential tool in remote sensing applications which integrates the information from combinations of panchromatic, multispectral or hyperspectral images; intended to result in a composite image having both higher spatial and higher spectral resolutions. The research in this area cites date back to last few decades, but the diverse approaches proposed so far by different researchers have been rarely discussed at one place. This paper is an honest attempt to collectively discuss all possible algorithms along with quality metrics following two assessment procedures i. e. at full and reduced scale resolutions to evaluate performance of these algorithms.

References

• John A. Richards, "Remote Sensing Digital Image Analysis", Springer, ISBN-13 978-3-540-25128-6, 2006
• H. B. Mitchell, "Image Fusion: Theories, Techniques And Applications", Springer-Verlag Berlin Heidelberg, e-ISBN 978-3-642-11216-4, 2010
• Yufeng Zheng, "Image Fusion And Its Applications", InTech Publication, ISBN 978-953-307-182-4, May 2011
• Zhijun Wang, Djemel Ziou, Costas Armenakis, Deren Li and Qingquan Li, "A Comparative Analysis of Image Fusion Methods", IEEE Transactions on Geoscience And Remote Sensing, Vol. 43, No. 6, June 2005, pp. 1391 –1402
• Veeraraghavan Vijayaraj, Nicolas H. Younan and Charles G. O'Hara, "Concepts of Image Fusion in Remote Sensing Applications", IEEE, Geoscience and Remote Sensing International Symposium - IGARSS, 2006, pp. 3781 – 3784
• Tian Hui and Wang Binbin, "Discussion and Analyze on Image Fusion Technology", IEEE, Second International Conference on Machine Vision (ICMV'09), 2009, pp. 246 – 250
• Zhao Dawei and Zi Fang, "A New Improved Hierarchical Model of Image Fusion", IEEE, The Eighth International Conference on Electronic Measurement and Instruments, ICEMI'2007, pp – 2-853 to 2-857
• Zhihui Wang, Yang Tie and Yueping Liu, "Design and Implementation of Image Fusion System", IEEE, International Conference on Computer Application and System Modeling (ICCASM), 2010, pp – V10-140 to V10-143
• Gemine Vivone, Luciano Alparone, Jocelyn Chanussot, Mauro Dalla Mura, Andrea Garzelli, Giorgio A. Licciardi, Rocco Restaino and Lucien Wald, "A Critical Comparison Among Pansharpening Algorithms", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 5, May 2015, pp. 2565 – 2586
• Wenqing Wang, Licheng Jiao and Shuyuan Yang, "Novel Adaptive Component-Substitution-Based Pan-Sharpening Using Particle Swarm Optimization", IEEE Geoscience And Remote Sensing Letters, Vol. 12, No. 4, April 2015, pp. 781 – 785
• Andrea Garzelli, "Pansharpening of Multispectral Images Based on Nonlocal Parameter Optimization", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 4, April 2015, pp. 2096 – 2107
• Qizhi Xu, Yun Zhang, Bo Li and Lin Ding, " Pansharpening Using Regression of Classified MS and Pan Images to Reduce Color Distortion", IEEE Geoscience And Remote Sensing Letters, Vol. 12, No. 1, January 2015, pp. 28 – 32
• Hamid Reza Shahdoosti and Hassan Ghassemian, "Fusion of MS and PAN Images Preserving Spectral Quality", IEEE Geoscience And Remote Sensing Letters, Vol. 12, No. 3, March 2015, pp. 611 – 615
• Abdelaziz Kallel, "MTF-Adjusted Pansharpening Approach Based on Coupled Multiresolution Decompositions", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 6, June 2015, pp. 3124 – 3145
• Kishor P. Upla Manjunath V. Joshi and Prakash P. Gajjar, "An Edge Preserving Multiresolution Fusion: Use of Contourlet Transform and MRF Prior", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 6, June 2015, pp. 3210 – 3220
• Gemine Vivone, Miguel Simões, Mauro Dalla Mura, Rocco Restaino, José M. Bioucas-Dias, Giorgio A. Licciardi and Jocelyn Chanussot, "Pansharpening Based on Semiblind Deconvolution", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 4, April 2015, pp. 1997 – 2010
• Syed Muhammad Umer Abdullah, Naveed ur Rehman, Muhammad Murtaza Khan and Danilo P. Mandic, "A Multivariate Empirical Mode Decomposition Based Approach to Pansharpening", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 7, July 2015, pp. 3974 – 3984
• Huihui Song, Bo Huang, Qingshan Liu and Kaihua Zhang, " Improving the Spatial Resolution of Landsat TM/ETM+ Through Fusion With SPOT5 Images via Learning-Based Super-Resolution", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 3, March 2015, pp. 195 – 1204
• Maria Rosaria Vicinanza, Rocco Restaino, Gemine Vivone, Mauro Dalla Mura and Jocelyn Chanussot, "A Pansharpening Method Based on the Sparse Representation of Injected Details", IEEE Geoscience And Remote Sensing Letters, Vol. 12, No. 1, January 2015, pp. 180 – 184
• Miguel Simões, José Bioucas-Dias, Luis B. Almeida and Jocelyn Chanussot, "A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 6, June 2015, pp. 3373 – 3388
• Xuejian Sun, Lifu Zhang, Hang Yang, Taixia Wu, Yi Cen and Yi Guo, "Enhancement of Spectral Resolution for Remotely Sensed Multispectral Image", IEEE Journal of Selected Topics In Applied Earth Observations And Remote Sensing
• Caroline M. Gevaert, Juha Suomalainen, Jing Tang and Lammert Kooistra, " Generation of Spectral–Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture Applications", IEEE Journal of Selected Topics In Applied Earth Observations And Remote Sensing
• Qi Wei, José Bioucas-Dias, Nicolas Dobigeon and Jean-Yves Tourneret, "Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 7, July 2015, pp. 3658 – 3668
• Frosti Palsson, Johannes R. Sveinsson, Magnus Orn Ulfarsson and Jon Atli Benediktsson, "Model-Based Fusion of Multi- and Hyperspectral Images Using PCA and Wavelets", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 5, May 2015, pp. 2652 -2663
• Claudia Paris and Lorenzo Bruzzone, "A Three-Dimensional Model-Based Approach to the Estimation of the Tree Top Height by Fusing Low-Density LiDAR Data and Very High Resolution Optical Images", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 1, January 2015, pp. 467 – 480
• Wenzhi Liao, Aleksandra Pižurica, Rik Bellens, Sidharta Gautama and Wilfried Philips, "Generalized Graph-Based Fusion of Hyperspectral and LiDAR Data Using Morphological Features", IEEE Geoscience And Remote Sensing Letters, Vol. 12, No. 3, March 2015, pp. 552 – 556
• Fatemeh Tabib Mahmoudi, Farhad Samadzadegan, and Peter Reinartz, Jr. , "Object Recognition Based on the Context Aware Decision-Level Fusion in Multiviews Imagery", IEEE Journal of Selected Topics In Applied Earth Observations And Remote Sensing Vol. 8, No. 1, January 2015, pp. 12 – 22
• Gianluca Gennarelli, Moeness G. Amin, Francesco Soldovieri and Raffaele Solimene, "Passive Multiarray Image Fusion for RF Tomography by Opportunistic Sources", IEEE Geoscience And Remote Sensing Letters, Vol. 12, No. 3, March 2015, pp. 641 – 645
• Yong Xu, Bo Huang, Yuyue Xu, Kai Cao, Chunlan Guo and Deyu Meng, " Spatial and Temporal Image Fusion via Regularized Spatial Unmixing", IEEE Geoscience And Remote Sensing Letters, Vol. 12, No. 6, June 2015, pp. 1362 – 1366
• Wei Li, Chen Chen, Hongjun Su and Qian Du, "Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification", IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 7, July 2015, pp. 3681 – 3693
• Zhang Yingjie and Ge Liling, "A Simple and Efficient Hybrid Image Fusion Approach", 3rd IEEE Conference on Industrial Electronics and Applications (ICIEA), 2008, pp. 1109 – 1113
• Benjamin W. Martin and Ranga R. Vatsavai, "Evaluating fusion techniques for multi-sensor satellite image data", Geospatial InfoFusion III, Proc. of SPIE, Vol. 8747, 2013, pp. 1 – 8
• Yuhong Ding and Yanhui Wang, "Analysis and Evaluation on Fusion Methods of Medium and High Spatial Resolution Remote Sensing Image", IEEE, 19th International Conference on Geoinformatics, 2011, pp. 1 – 4
• Myungjin Choi, "A New Intensity-Hue-Saturation Fusion Approach to Image Fusion With a Tradeoff Parameter", IEEE Transactions on Geoscience And Remote Sensing, Vol. 44, No. 6, June 2006, pp. 1672 – 1682
• Heng Chu and Weile Zhu, "Fusion of IKONOS Satellite Imagery Using IHS Transform and Local Variation", IEEE Geoscience And Remote Sensing Letters, Vol. 5, No. 4, October 2008, pp. 653 – 657
• Chun-Liang Chien and Wen-Hsiang Tsai, "Image Fusion With No Gamut Problem by Improved Nonlinear IHS Transforms for Remote Sensing", IEEE Transactions on Geoscience And Remote Sensing, Vol. 52, No. 1, January 2014, pp. 651 – 663
• Changtao He, Quanxi Liu, Hongliang Li and Haixu Wang, " Multimodal medical image fusion based on IHS and PCA", Symposium on Security Detection and Information Processing, Procedia Engineering 7, Elsevier Ltd. , 2010, pp. 280 – 285
• Wenkao Yang, Jing Wang and Jing Guo, "A Novel Algorithm for Satellite Images Fusion Based on Compressed Sensing and PCA", Hindawi Publishing Corporation, Mathematical Problems in Engineering, Volume 2013, pp. 1 – 10
• Xin Huang, Dawei Wen, Junfeng Xie and Liangpei Zhang, "Quality Assessment of Panchromatic and Multispectral Image Fusion for the ZY-3 Satellite: From an Information Extraction Perspective", IEEE Geoscience And Remote Sensing Letters, Vol. 11, No. 4, April 2014, pp. 753 – 757
• M. Pradeep, "Implementation of Image Fusion algorithm using MATLAB (LAPLACIAN PYRAMID)", IEEE, International Multi-Conference on Automation, Computing, Communication, Control and Compressed Sensing (iMac4s), 2013, pp. 165 – 168
• Hui Lee, B. S. Manjunath and Snjeet k. Mitra, "Multi-Sensor Image Fusion Using The Wavelet Transform", IEEE, International Conference on Image Processing (ICIP-94), 1994, pp. 51 – 55
• Anna Wang, Haijing Sun and Yueyang Guan, "The Application of Wavelet Transform to Multi-modality Medical Image Fusion", IEEE, International Conference on Networking, Sensing and Control (ICNSC'06), 2006, pp. 270 – 274
• Yan Sun, Chunhui Zhao and Ling Jiang, "A New Image Fusion Algorithm Based on Wavelet Transform and the Second Generation Curvelet Transform", IEEE, International Conference on Image Analysis and Signal Processing (IASP), 2010, pp. 1 – 4
• Myungjin Choi, Rae Young Kim, Myeong-Ryong Nam and Hong Oh Kim, "Fusion of Multispectral and Panchromatic Satellite Images Using the Curvelet Transform", IEEE Geoscience And Remote Sensing Letters, Vol. 2, No. 2, April 2005, pp. 136 – 140
• LIU Fu, LI Jin and Huang Caiyun, "Image Fusion Algorithm Based on Simplified PCNN in Nonsubsampled Contourlet Transform Domain", International Workshop on Information and Electronics Engineering (IWIEE), Procedia Engineering 29, Elsevier Ltd. , 2012, pp. 1434 – 1438
• Saad M. Darwish, "Multi-level fuzzy contourlet-based image fusion for medical applications", IET Image Processing, Volume 7, Issue 7, ISSN 1751-9659, 2013, pp. 694 – 700
• Shaohui Chen, Hongbo Su, Renhua Zhang, Jing Tian and Lihu Yang, "The Tradeoff Analysis for Remote Sensing Image Fusion Using Expanded Spectral Angle Mapper", Sensors, ISSN 1424-8220, January 2008, pp. 520 – 528
• Shutao Li, Haitao Yin and Leyuan Fang, "Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries", IEEE Transactions on Geoscience And Remote Sensing, Vol. 51, No. 9, September 2013, pp. 4779 – 4789