图像去雾的最新研究进展

吴迪; 朱青松

doi:10.16383/j.aas.2015.c131137

图像去雾的最新研究进展

doi: 10.16383/j.aas.2015.c131137

吴迪^1,2,
朱青松^1, ,

1.
中国科学院深圳先进技术研究院医疗机器人与微创手术器械研究中心深圳 518055;
2.
上海交通大学软件学院上海 200240

基金项目:

国家重点基础研究发展计划(973计划)(2010CB732606),国家自然科学基金(61303166)资助

详细信息

作者简介:
吴迪上海交通大学软件学院硕士研究生. 中国科学院深圳先进技术研究院客座学生. 主要研究方向为计算机视觉与机器学习.E-mail: gandwudi@hotmail.com

通讯作者:
朱青松中国科学院深圳先进技术研究院医疗机器人与微创手术器械研究中心副研究员. 2010 年获中国科学技术大学硕士学位. 主要研究方向为机器人视觉技术基础研究, 核与支持向量机, 统计模式识别, 机器学习, 图灵测试与图灵自动机以及图像引导微创手术机器人. 本文通信作者. E-mail: qs.zhu@siat.ac.cn

计量
- 文章访问数: 4944
- HTML全文浏览量: 280
- PDF下载量: 4415
- 被引次数: 0
出版历程
- 收稿日期: 2013-12-16
- 修回日期: 2014-06-10
- 刊出日期: 2015-02-20

The Latest Research Progress of Image Dehazing

WU Di^1,2,
ZHU Qing-Song^{1
, ,}

1.
Research Center for Medical Robotics and Minimally Invasive Surgical Devices, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055;
2.
School of Software, Shanghai Jiao Tong University, Shanghai 200240

Funds:

Supported by National Basic Research Program of China (973 Program) (2010CB732606), and National Natural Science Foundation of China (61303166)

摘要

摘要: 随着计算机视觉系统的发展及其在军事、交通以及安全监控等领域的发展, 图像去雾已成为计算机视觉的重要研究方向. 在雾、霾之类的恶劣天气下采集的图像会由于大气散射的作用而被严重降质, 使图像颜色偏灰白色, 对比度降低, 物体特征难以辨认, 不仅使视觉效果变差, 图像观赏性降低, 还会影响图像后期的处理, 更会影响各类依赖于光学成像仪器的系统工作, 如卫星遥感系统、航拍系统、室外监控和目标识别系统等. 因此, 需要图像去雾技术来增强或修复, 以改善视觉效果和方便后期处理. 本文归纳总结了两大类图像去雾方法:基于图像增强和基于物理模型的方法, 深入探讨了其中的典型算法和研究成果, 并对这些算法的测试结果进行了定性和定量的分析比较, 最后总结了图像去雾技术目前的研究状况和未来的发展方向.
- 图像去雾 /
- 图像增强 /
- 大气散射模型 /
- 图像处理
Abstract: With the development of computer vision system and the increasing demand in military, transportation and surveillance applications, image dehazing has been an important researching direction in computer vision. Images acquired in bad weather, such as haze and fog, are seriously degraded by the scatting of the atmosphere, which makes the image color gray, reduces the contrast and makes the object features difficult to identify. The bad weather not only leads to the variation of the visual effect of the image, but also cause the disadvantage of the post processing to the image, as well as inconvenience of all kinds of instruments which rely on optical imaging, such as satellite remote sensing system, aerial photo system, outdoor monitoring system and object identification system. That is the reason why the image need enhancement and restoration for the improvement of the visual effects and convenience of post processing. This paper sums up two kinds of image dehazing methods, which are the methods based on image enhancement and based on the physics model. After that, some algorithms and research results are presented, followed by quantitative and qualitative evaluations of these techniques. Finally, the research progress is summarized and future research directions are suggested.
- Image dehazing /
- image enhancement /
- atmospheric scatting model /
- image processing

HTML全文

参考文献(75)

[1]	Gonzalez R C, Woods R E. Digital Image Processing. Reading, MA: Addison-Wesley, 1992.
[2]	[2] Nayar S K, Narasimhan S G. Vision in bad weather. In: Proceedings of the 7th IEEE International Conference on Computer Vision. Kerkyra: IEEE, 1999, 2: 820-827
[3]	[3] Narasimhan S G, Nayar S K. Vision and the atmosphere. International Journal of Computer Vision, 2002, 48(3): 233-254
[4]	[4] Narasimhan S G, Nayar S K. Contrast restoration of weather degraded images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(6): 713-724
[5]	[5] Narasimhan S G, Nayar S K. Removing weather effects from monochrome images. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001). Kauai: IEEE, 2001, 2: II-186-II-193
[6]	[6] Hautire N, Tarel J P, Lavenant J, Aubert D. Automatic fog detection and estimation of visibility distance through use of an onboard camera. Machine Vision and Applications, 2006, 17(1): 8-20
[7]	[7] Kim T K, Paik J K, Kang B S. Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering. IEEE Transactions on Consumer Electronics, 1998, 44(1): 82-87
[8]	[8] Stark J A. Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Transactions on Image Processing, 2000, 9(5): 889-896
[9]	[9] Kim J Y, Kim L S, Hwang S H. An advanced contrast enhancement using partially overlapped sub-block histogram equalization. IEEE Transactions on Circuits and Systems for Video Technology, 2001, 11(4): 475-484
[10]	Eriksson A, Capi G, Doya K. Evolution of meta-parameters in reinforcement learning algorithm. In: Proceedings of the 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2003. Las Vegas: IEEE, 2003. 1, 412-417
[11]	Seow M J, Asari V K. Ratio rule and homomorphic filter for enhancement of digital colour image. Neurocomputing, 2006, 69(7-9): 954-958
[12]	Russo F. An image enhancement technique combining sharpening and noise reduction. IEEE Transactions on Instrumentation and Measurement, 2002, 51(4): 824-828
[13]	Dippel S, Stahl M, Wiemker R, Blaffert T. Multiscale contrast enhancement for radiographies: Laplacian pyramid versus fast wavelet transform. IEEE Transactions on Medical Imaging, 2002, 21(4): 343-353
[14]	Land E H. The retinex theory of color vision. Scientific America, 1977, 237(6): 108-128
[15]	Land E H. The retinex. American Scientist, 1964, 52(2): 247-264
[16]	Land E H, McCann J J. Lightness and retinex theory. Journal of the Optical society of America, 1971, 61(1): 1-11
[17]	Land E H. Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. Proceedings of the National Academy of Sciences of the United States of America, 1983, 80(16): 5163-5169
[18]	Frankle J A, McCann J J. Method and Apparatus for Lightness Imaging: USA. Patent 4384336, May 1983.
[19]	Jobson D J, Rahman Z, Woodell G A. Properties and performance of a center/surround retinex. IEEE Transactions on Image Processing, 1997, 6(3): 451-462
[20]	Land E H. An alternative technique for the computation of the designator in the retinex theory of color vision. Proceedings of the National Academy of Sciences of the United States of America , 1986, 83(10): 3078-3080
[21]	Rahman Z, Jobson D J, Woodell G A. Multi-scale retinex for color image enhancement. In: Proceedings of the 1996 International Conference on Image Processing. Lausanne: IEEE, 1996, 3: 1003-1006
[22]	Rui Yi-Bin, Li Peng, Sun Jin-Tao. Method of removing fog effect from images. Computer Applications, 2006, 26(1): 154-156 (芮义斌, 李鹏, 孙锦涛. 一种图像去薄雾方法. 计算机应用, 2006, 26(1): 154-156)
[23]	Rahman Z, Jobson D J, Woodell G A. Retinex processing for automatic image enhancement. Journal of Electronic Imaging, 2004, 13(1): 100-110
[24]	Jobson D J, Rahman Z, Woodell G A. Retinex image processing: improved fidelity to direct visual observation. In: Proceedings of the 1996 Color and Image Conference. Society for Imaging Science and Technology, 1996(1): 124-125
[25]	Jobson D J, Rahman Z, Woodell G A. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Transactions on Image Processing, 1997, 6(7): 965-976
[26]	Rahman Z, Woodell G A, Jobson D J. A comparison of the multiscale retinex with other image enhancement techniques. In: Proceedings of the 1997 IS AND T Annual Conference. The Society for Image Science and Technology, 1997. 426-431
[27]	Joshi K R, Kamathe R S. Quantification of retinex in enhancement of weather degraded images. In: Proceedings of the 2008 International Conference on Audio, Language, and Image Processing, 2008. Shanghai: IEEE, 2008. 1229-1233
[28]	Oakley J P, Satherley B L. Improving image quality in poor visibility conditions using a physical model for contrast degradation. IEEE Transactions on Image Processing, 1998, 7(2): 167-179
[29]	Tan K K, Oakley J P. Physics-based approach to color image enhancement in poor visibility conditions. Journal of the Optical Society of America A, 2001, 18(10): 2460-2467
[30]	Kopeika N S. General wavelength dependence of imaging through the atmosphere. Applied Optics, 1981, 20(9): 1532-1536
[31]	Minnaert M G J. The Nature of Light and Colour in the Open Air. Courier Dover Publications, 1954.
[32]	McCartney E J. Optics of the Atmosphere: Scattering by Molecules and Particles. New York: John Wiley and Sons, Inc., 1976.
[33]	Hautire N, Tarel J P, Aubert D. Towards fog-free in-vehicle vision systems through contrast restoration. In: Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, 2007. Minneapolis, MN: IEEE, 2007. 1-8
[34]	Kopf J, Neubert B, Chen B, Cohen M F, Cohen-Or D, Deussen O, Uyttendaele M, Lischinski D. Deep photo: model-based photograph enhancement and viewing. In: Proceedings of the 2008 ACM Transactions on Graphics (TOG). New York, NY, USA: ACM, 2008, 27(5): Article No. 116
[35]	Narasimhan S G, Nayar S K. Interactive (de) weathering of an image using physical models. In: Proceedings of the 2003 IEEE Workshop on Color and Photometric Methods in Computer Vision. France, IEEE, 2003. 6(6.4): 1
[36]	Sun Yu-Bao, Xiao Liang, Wei Zhi-Hui, Wu Hui-Zhong. Method of defogging image of outdoor scenes based on PDE. Journal of System Simulation, 2007, 19(16): 3739-3744 (孙玉宝, 肖亮, 韦志辉, 吴慧中. 基于偏微分方程的户外图像去雾方法. 系统仿真学报, 2007, 19(16): 3739-3744)
[37]	Narasimhan S G, Nayar S K. Chromatic framework for vision in bad weather. In: Proceedings of the 2000 IEEE Conference on Computer Vision and Pattern Recognition. Hilton Head Island, SC: IEEE, 2000, 1: 598-605
[38]	Schechner Y Y, Narasimhan S G, Nayar S K. Instant dehazing of images using polarization. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Kaual, HI: IEEE, 2001, 1: I-325-I-332
[39]	Schechner Y Y, Narasimhan S G, Nayar S K. Polarization-based vision through haze. Applied Optics, 2003, 42(3): 511-525
[40]	Namer E, Schechner Y Y. Advanced visibility improvement based on polarization filtered images. In: Proceedings of the 2005 Optics Photonics. International Society for Optics and Photonics, 2005, 5888: 36-45
[41]	Shwartz S, Namer E, Schechner Y Y. Blind haze separation. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2006, 2: 1984-1991
[42]	Schechner Y Y, Averbuch Y. Regularized image recovery in scattering media. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(9): 1655-1660
[43]	Tan R T. Visibility in bad weather from a single image. In: Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition. Anchorage, AK: IEEE, 2008. 1-8
[44]	Fattal R. Single image dehazing. In: Proceedings of the 2008 ACM Transactions on Graphics (TOG). New York, NY, USA: ACM, 2008, 27(3): Article No.72
[45]	He K, Sun J, Tang X. Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(12): 2341-2353
[46]	Gibson K B, Nguyen T Q. On the effectiveness of the dark channel prior for single image dehazing by approximating with minimum volume ellipsoids. In: Proceedings of the 2011 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). Prague: IEEE, 2011. 1253-1256
[47]	Shi De-Fei, Li Bo, Ding Wen, Chen Qi-Mei. Haze removal and enhancement using transmittance-dark channel prior based on object spectral characteristic. Acta Automatica Sinica, 2013, 39(12): 2064-2070 (史德飞, 李勃, 丁文, 陈启美. 基于地物波谱特性的透射率---暗原色先验去雾增强算法. 自动化学报, 2013, 39(12): 2064-2070)
[48]	He K M, Sun J, Tang X O. Guided image filtering. In: Proceedings of the 2010 European Conference on Computer Vision---ECCV. Berlin Heidelberg: Springer, 2010. 1-14
[49]	Kratz L, Nishino K. Factorizing scene albedo and depth from a single foggy image. In: Proceedings of the 12th IEEE International Conference on Computer Vision, 2009. Kyoto: IEEE, 2009. 1701-1708
[50]	Nishino K, Kratz L, Lombardi S. Bayesian defogging. International Journal of Computer Vision, 2012, 98(3): 263-278
[51]	Wang Duo-Chao, Wang Yong-Guo, Dong Xue-Mei, Hu Xi-Yuan, Peng Si-Long. Single image dehazing based on Bayesian framework. Journal of Computer-Aided Design Computer Graphics, 2010, 22(10): 1756-1761 (王多超, 王永国, 董雪梅, 胡晰远, 彭思龙. 贝叶斯框架下的单幅图像去雾算法. 计算机辅助设计与图形学学报, 2010, 22(10): 1756-1761)
[52]	Tarel J P, Hautiere N. Fast visibility restoration from a single color or gray level image. In: Proceedings of the 12th IEEE International Conference on Computer Vision, 2009. Kyoto: IEEE, 2009. 2201-2208
[53]	Ancuti C, Bekaert P. Effective single image dehazing by fusion. In: Proceedings of the 17th IEEE International Conference on Image Processing (ICIP), 2010. Hong Kong, China: IEEE, 2010. 3541-3544
[54]	Li Quan-He, Bi Du-Yan, Xu Yue-Lei, Zha Yu-Fei. Haze degraded image scene rendition. Acta Automatica Sinica, 2014, 40(4): 744-750(李权合, 毕笃彦, 许悦雷, 查宇飞. 雾霾天气下可见光图像场景再现. 自动化学报, 40(4): 744-750)
[55]	Fang F, Li F, Yang X M, Shen C M. Single image dehazing and denoising with variational method. In: Proceedings of the 2010 International Conference on Image Analysis and Signal Processing (IASP). Xiamen, China: IEEE, 2010. 219-222
[56]	Matlin E, Milanfar P. Removal of haze and noise from a single image. In: Proceedings of the 2012 IST/SPIE Electronic Imaging. International Society for Optics and Photonics. 2012. 82960T-82960T-12
[57]	Dabov K, Foi A, Katkovnik V, Egiazarian K. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Transactions on Image Processing, 2007, 16(8): 2080-2095
[58]	Ding M, Tong R F. Efficient dark channel based image dehazing using quadtrees. Science China Information Sciences, 2012, 56(9): 1-9
[59]	Zhu Q Z, Heng P A, Shao L, Li X L. A novel segmentation guided approach for single image dehazing. In: Proceedings of the 2013 IEEE International Conference Robotics and Biomimetics (ROBIO). Shenzhen: IEEE, 2013. 2414-2417
[60]	Pei S C, Lee T Y. Nighttime haze removal using color transfer pre-processing and dark channel prior. In: Proceedings of the 19th IEEE International Conference on Image Processing (ICIP). Orlando, FL: IEEE, 2012. 957-960
[61]	Reinhard E, Adhikhmin M, Gooch B, Shirley P. Color transfer between images. IEEE Transactions on Computer Graphics and Applications, 2001, 21(5): 34-41
[62]	Schettini R, Gasparini F, Corchs S, Marini F, Capra A, Castorina A. Contrast image correction method. Journal of Electronic Imaging, 2010, 19(2): 023005
[63]	Yu J, Liao Q M. Fast single image fog removal using edge-preserving smoothing. In: Proceedings of the 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Prague: IEEE, 2011. 1245-1248
[64]	Tomasi C, Manduchi R. Bilateral filtering for gray and color images. In: Proceedings of the 6th International Conference on Computer Vision. Bombay: IEEE, 1998. 839-846
[65]	Xiao C X, Gan J J. Fast image dehazing using guided joint bilateral filter. The Visual Computer, 2012, 28(6-8): 713-721
[66]	Kopf J, Cohen M F, Lischinski D, Uyttendaele M. Joint bilateral upsampling. ACM Transactions on Graphics, 2007, 26(3): Article No.96, doi: 10.1145/1276377.1276497
[67]	Petschnigg G, Szeliski R, Agrawala M, Cohen M, Hoppe H, Toyama K. Digital photography with flash and no-flash image pairs. The 2004 ACM Transactions on Graphics (TOG), 2004, 23(3): 664-672
[68]	Feng C, Zhuo S J, Zhang X P, Shen L, Ssstrunk S. Near-infrared guided color image dehazing. In: Proceedings of the 20th IEEE International Conference on Image Processing (ICIP). Melbourne, MC: IEEE, 2013. 2363-2013
[69]	Jobson D J, Rahman Z, Woodell G A, Hines G D. A comparison of visual statistics for the image enhancement of foresite aerial images with those of major image classes. In: Proceedings of the 2006 Defense and Security Symposium. International Society for Optics and Photonics. Visual Information Processing XV: SPIE, 2006. 624601-624601-8
[70]	Wang Z, Bovik A C. A universal image quality index. IEEE Signal Processing Letters, 2002, 9(3): 81-84
[71]	Wang Z, Bovik A C, Sheikh H R, Simoncelli E P. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 2004, 13(4): 600-612
[72]	Wang Z, Simoncelli E P, Bovik A C. Multiscale structural similarity for image quality assessment. In: Proceedings of the Conference Record of the 37th Asilomar Conference on Signals, Systems, and Computers. Pacific Grove: IEEE, 2003, 2: 1398-1402
[73]	Hautire N, Tarel J P, Aubert D, Dumont . Blind contrast enhancement assessment by gradient ratioing at visible edges. Image Analysis Stereology Journal, 2008, 27(2): 87-95
[74]	Guo Fan, Cai Zi-Xing. Objective assessment method for the clearness effect of image defogging algorithm. Acta Automatica Sinica, 2012, 38(9): 1410-1419 (郭璠, 蔡自兴. 图像去雾算法清晰化效果客观评价方法. 自动化学报, 2012, 38(9): 1410-1419)
[75]	Li Da-Peng, Yu Jing, Xiao Chuang-Bai. No-reference quality assessment method for defogged images. Journal of Image and Graphics, 2011, 16(9): 1753-1757 (李大鹏, 禹晶, 肖创柏. 图像去雾的无参考客观质量评测方法. 中国图象图形学报, 2011, 16(9): 1753-1757)