一种视频雨滴检测与消除的方法

董蓉; 李勃; 陈启美

doi:10.3724/SP.J.1004.2013.01093

一种视频雨滴检测与消除的方法

doi: 10.3724/SP.J.1004.2013.01093

1.
南京大学南京 210046

基金项目:

国家自然科学基金(61105015),江苏省自然科学基金(BK2010366),江苏省科技厅项目(BE2011747)资助

详细信息

通讯作者:
李勃

计量
- 文章访问数: 1754
- HTML全文浏览量: 55
- PDF下载量: 2053
- 被引次数: 0
出版历程
- 收稿日期: 2011-10-28
- 修回日期: 2012-12-06
- 刊出日期: 2013-07-20

A Method for Detection and Removal of Rain in Videos

1.
Nanjing University, Nanjing 210046

Funds:

Supported by National Natural Science Foundation of China (61105015), Natural Science Foundation of Jiangsu Province (BK2010366), and Research Project of Science and Technology Department of Jiangsu Province (BE2011747)

摘要

摘要: 降雨天气往往导致监控视频质量下降. 本文提出首先在对数图像处理(Logarithmic image processing, LIP)框架下利用灰色调约束检测出候选雨滴,进而利用主成分分析(Principal component analysis, PCA)方法计算每个候选雨滴的倾斜方向并构建其概率密度分布函数,利用Mean-shift算法估计该分布函数的峰值,作为检测到的雨滴降落方向,然后,通过方向约束去除候选雨滴中的干扰噪声. 最后,文章采用一种加权的重构方法消除雨滴. 实验证明,算法能够有效检测并去除各种场景中的雨滴.
- 对数图像处理 /
- 均值漂移 /
- 主成分分析 /
- 雨滴消除
Abstract: Rain may deteriorate the quality of surveillance videos. In this paper, we propose firstly to detect candidate raindrops in the logarithmic image processing (LIP) framework using constraints of gray tone. Then the tilt angle of each candidate raindrop is calculated using principal component analysis (PCA) and a probability density function of orientation is constructed. Mean-shift is used to estimate the peak of the distribution and it is considered to be the direction of detected falling raindrops, and noise blobs are eliminated by restricting the direction of candidate raindrops. Finally, a weighted composing method is used to remove rain. Experiments have demonstrated that the algorithm is able to detect and remove rain in a variety of scenes.
- Logarithmic image processing (LIP) /
- mean-shift /
- principal component analysis (PCA) /
- rain removal

HTML全文

参考文献(15)

[1]	Garg K, Nayar S K. Vision and rain. International Journal of Computer Vision, 2007, 75(1): 3-27
[2]	Garg K, Nayar S K. Detection and removal of rain from videos. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington D.C., USA: IEEE, 2004. I-528-I-535
[3]	Brewer N, Liu N J. Using the shape characteristics of rain to identify and remove rain from video. In: Proceedings of the 2008 Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition. Berlin, Heidelberg: Springer-Verlag, 2008, 5342: 451-458
[4]	Miao Y, Hong H N, Kim H. Size and angle filter based rain removal in video for outdoor surveillance systems. In: Proceedings of the 8th Asian Control Conference. Kaohsiung, Taiwan, China: IEEE, 2011. 1300-1304
[5]	Zhang X P, Li H, Qi Y Y, Leow W K, Ng T K. Rain removal in video by combining temporal and chromatic properties. In: Proceedings of the 2006 International Conference on Multimedia and Expo. Toronto, Canada: IEEE, 2006. 461-464
[6]	Liu Peng, Xu Jing, Liu Jia-Feng, Tang Xiang-Long. An algorithm for real-time analysis of rain-affected videos. Acta Automatica Sinica, 2010, 36(10): 1371-1378 (刘鹏, 徐晶, 刘家锋, 唐降龙. 一种受雨滴污染视频的快速分析方法. 自动化学报, 2010, 36(10): 1371-1378)
[7]	Bossu J, Hautiére N, Tarel J P. Rain or snow detection in image sequences through use of a histogram of orientation of streaks. International Journal of Computer Vision, 2011, 93(3): 348-367
[8]	Barnum P C, Narasimhan S G, Kanade T. Analysis of rain and snow in frequency space. International Journal of Computer Vision, 2010, 86(2-3): 256-274
[9]	Pinoli J C. The logarithmic image processing model: connections with human brightness perception and contrast estimators. Journal of Mathematical Imaging and Vision, 1997, 7(4): 341-358
[10]	Jourlin M, Pinoli J C. Logarithmic image processing: the mathematical and physical framework for the representation and processing of transmitted images. Advances in Imaging and Electron Physics, 2001, 115: 129-196
[11]	Panetta K, Agaian S, Zhou Y C, Wharton E J. Parameterized logarithmic framework for image enhancement. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2011, 41(2): 460-473
[12]	Zhang Xin-Long, Wang Rong-Gui, Zhang Xuan, Zhu Jing. Calculation model and algorithm in foggy image enhancement. Journal of Image and Graphics, 2011, 16(8): 1359-1368 (张新龙, 汪荣贵, 张璇, 朱静. 雾天图像增强计算模型及算法. 中国图象图形学报, 2011, 16(8): 1359-1368)
[13]	Deng G. A generalized logarithmic image processing model based on the gigavision sensor model. IEEE Transactions on Image Processing, 2012, 21(3): 1406-1414
[14]	Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning. America: Springer, 2001. 64-67
[15]	Comaniciu D, Meer P. Mean shift: a robust approach toward feature space analysis. IEEE Transactions on Pattern Recognition and Machine Learning, 2002, 24(5): 603-619