Pan-sharpening Model Based on MTF and Variational Method
-
摘要: Pan-sharpening将高分辨率图像全色(Panchromatic, Pan)波段的空间细节注入多光谱(Multispectral, MS)波段, 以生成同时具有高光谱和高空间分辨率的多光谱图像. 为改善融合效果, 需要考虑多光谱和全色波段的调制传输函数(Modulation transfer function, MTF). 本文提出了一个新的基于MTF和变分的Pan-sharpening模型. 该模型的能量泛函包括两项, 第1项为细节注入项, 基于高通滤波器从Pan波段中提取细节信息并注入融合图像;第2项为光谱保真项, 基于MTF设计多孔小波的低通滤波器以保持MS波段的多光谱信息. 在QuickBird、IKONOS和GeoEye数据集上的融合结果表明, 该模型可以生成同时具有高空间和高光谱质量的融合图像, 融合效果优于AWLP、IHS_BT、HPM-CC-PSF、NAWL、快速变分等算法.
-
关键词:
- 图像融合 /
- Pan-sharpening /
- 调制传输函数 /
- 变分 /
- 多孔小波
Abstract: In order to provide the multispectral (MS) image with both high spectral and high spatial resolution, pan-sharpening approach introduces the spatial details of Panchromatic (Pan) band into MS band. Modulation transfer function (MTF) of MS and Pan bands is necessary for high fusion quality. This paper proposes a novel pan-sharpening model based on MTF and variational method. The energy functional of the proposed model consists of two terms. The first one is the spatial detail injection term, which injects detail information extracted from Pan band by a high-pass filter into MS image. The second one is the spectral signature preserving terms, in which a low-pass filter of trouswavelet is designed to maintain the multispectral information based on MTF of MS band. The experimental results on QuickBird/IKONOS/GeoEye datasets demonstrate that this model can produce the fused MS image with high spectral and high spatial quality. The proposed model is superior to AWLP, IHS_BT, HPM-CC-PSF, NAWL and fast variational method in fusion performance. -
[1] Otazu X, Gonzalez-Audicana M, Fors O, Nunez J. Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods. IEEE Transactions on Geoscience and Remote Sensing, 2005, 43(10): 2376-2385 [2] [2] Amro I, Mateos J, Vega M, Molina R, Katsaggelos A K. A survey of classical methods and new trends in Pansharpening of multispectral images. EURASIP Journal on Advances in Signal Processing, 2011. 79 [3] [3] Khan M M, Alparone L, Chanussot J. Pansharpening quality assessment using the modulation transfer functions of instruments. IEEE Transactions on Geoscience and Remote Sensing, 2009, 47(11): 3880-3891 [4] [4] Tu T M, Su S C, Shyu H C, Huang P S. A new look at IHS-like image fusion methods. Information Fusion, 2001, 2(3): 177-186 [5] [5] Tu T M, Huang P S, Huang C L, Chang C P. A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Transactions on Geoscience and Remote Sensing Letters, 2004, 1(4): 309-312 [6] [6] Chavez P S Jr, Sides S C, Anderson J A. Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic. Photogrammetric Engineering Remote Sensing, 1991, 57(3): 295-303 [7] [7] Tu T M, Hsu C L, Tu P Y, Lee C H. An adjustable Pan-sharpening approach for IKONOS/QuickBird/GeoEye-1/WorldView-2 imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2012, 5(1): 125-134 [8] [8] Nunez J, Otazu X, Fors O, Prades A, Pala V, Arbiol R. Multiresolution-based image fusion with additive wavelet decomposition. IEEE Transactions on Geoscience and Remote Sensing, 1999, 37(3): 1204-1211 [9] [9] Aiazzi B, Alparone L, Baronti S, Garzelli A. Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis. IEEE Transactions on Geoscience and Remote Sensing, 2002, 40(10): 2300-2312 [10] Ranchin T, Aiazzi B, Alparone L, Baronti S, Wald L. Image fusion-the ARSIS concept and some successful implementation schemes. ISPRS Journal of Photogrammetry and Remote Sensing, 2003, 58(1-2): 4-18 [11] Massip P, Blanc P, Wald L. A method to better account for modulation transfer functions in ARSIS-based pansharpening methods. IEEE Transactions on Geoscience and Remote Sensing, 2012, 50(3): 800-808 [12] Gonzalez-Audicana M, Saleta J L, Catalan R G, Garcia R. Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition. IEEE Transactions on Geoscience and Remote Sensing, 2004, 42(6): 1291-1299 [13] Shah V P, Younan N H, King R L. An efficient Pan-sharpening method via a combined adaptive PCA approach and contourlets. IEEE Transactions on Geoscience and Remote Sensing, 2008, 46(5): 1323-1335 [14] Garzelli A, Nencini F. Interband structure modeling for Pan-sharpening of very high-resolution multispectral images. Information Fusion, 2005, 6(3): 213-224 [15] Dou Wen, Chen Yun-Hao. Mage fusion method of high-pass modulation including interband correlations. Journal of Infrared and Millimeter Waves, 2010, 29(2): 140-144 (窦闻, 陈云浩. 计入波段间相关性的高通调制图像融合方法. 红外与毫米波学报, 2010, 29(2): 140-144) [16] Liu Bin, Peng Jia-Xiong. Fusion method of multi-spectral image and panchromatic image based on four channels non-separable additive wavelets. Chinese Journal of Computers, 2009, 32(2): 350-356(刘斌, 彭嘉雄. 基于四通道不可分加性小波的多光谱图像融合. 计算机学报, 2009, 32(2): 350-356) [17] Aly H A, Sharma G. A regularized model-based optimization framework for Pan-sharpening. IEEE Transactions on Image Processing, 2014, 23(6): 2596-2608 [18] Zhou Z M, Li Y X, Shi H Q, Ma N, Shen J. Pan-sharpening: a fast variational fusion approach. Science China Information Sciences, 2012, 55(3): 615-625 [19] Dai Qi-Yan, Xia De-Shen, He Hong-Yan, Man Yi-Yun, Zong Yun-Hua. Performance analysis of MTF measurement using edge method. Spacecraft Recovery Remote Sensing, 2006, 27(3): 22-27 (戴奇燕, 夏德深, 何红艳, 满益云, 宗云花. 刀刃法在轨MTF测量性能分析. 航天返回与遥感, 2006, 27(3): 22-27) [20] Wald L. Quality of high resolution synthesized images: is there a simple criterion? In: Proceedings of the 3rd Conference Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images. Nice, France: SEE/URISCA, 2000. 99-103 [21] Wald L, Ranchin T, Mangolini M. Fusion of satellite images of different spatial resolutions: assessing the quality of resulting images. Photogrammetric Engineering Remote Sensing, 1997, 63(6): 691-699 [22] Wang Z, Bovik A C. A universal image quality index. IEEE Signal Processing Letter, 2002, 9(3): 81-84 [23] Zhou J, Civco D L, Silander J A. A wavelet transform method to merge Landsat TM and SPOT panchromatic data. International Journal of Remote Sensing, 1998, 19(4): 743-757 [24] Alparone L, Wald L, Chanussot J, Thomas C, Gamba P, Bruce L M. Comparison of Pansharpening algorithms: outcome of the 2006 GRS-S data-fusion contest. IEEE Transactions on Geoscience and Remote Sensing, 2007, 45(10): 3012-3021
点击查看大图
计量
- 文章访问数: 2083
- HTML全文浏览量: 98
- PDF下载量: 1475
- 被引次数: 0