Chaotic Features for Motion Pattern Segmentation and Dynamic Texture Classification
-
摘要: 采用混沌理论对动态纹理中的像素值序列建模,提取动态纹理中的像素值序列的相关特征量,将视频用特征向量矩阵表示. 通过均值漂移(Mean shift)算法对矩阵中的特征向量聚类,实现对视频中的运动模式分割. 然后,采用地球移动距离(Earth mover’s distance,EMD)度量不同视频的差异,对动态纹理视频分类. 本文对多个数据库测试表明:1)分割算法可以分割出视频中不同的运动模式;2)提出的特征向量可以很好地描述动态纹理系统;3)分类算法可以对动态纹理视频分类,且对视频中噪声干扰具有一定的鲁棒性.Abstract: In this paper, we propose a novel framework for dynamical texture modeling based on chaos theory. Our method first extracts features from dynamical texutre and concatenate the features to a feature vector. A video is then represented by a feature matrix. The mean shift clustering algorithm is used to cluster the feature vector which achieves segmenting videos into different motion patterns. The earth mover's distance (EMD) is employed to compute the feature cluster similarities and classify the dynamic textures. Experimental results indicate that: 1) The segmentation algorithm can cluster different motion patterns in videos; 2) The feature vector proposed in this paper can effectively characterize the dynamical texture; 3) The proposed algorithm can classify dynamical texture accurately. In addition, the algorithm is robust to video noise.
-
Key words:
- Dynamic texture /
- chaotic features /
- mean shift /
- earth mover’s distance (EMD)
-
[1] Field D J. Relations between the statistics of natural images and the response properties of cortical cells. Journal of the Optical Society of America, 1987, 4(12): 2379-2394 [2] Doretto G, Chiuso A, Wu Y N, Soatto S. Dynamic textures. International Journal of Computer Vision, 2003, 51(2): 91-109 [3] Chan A B, Vasconcelos N. Mixtures of dynamic textures. In: Proceedings of the 10th IEEE International Conference on Computer Vision. Beijing, China: IEEE, 2005. 641-647 [4] Chan A B, Vasconcelos N. Classifying video with kernel dynamic textures. In: Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, USA: IEEE, 2007. 1-6 [5] Chan A B, Vasconcelos N. Probabilistic kernels for the classification of auto-regressive visual processes. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Diego, USA: IEEE, 2005. 846-851 [6] Kantz H, Schreiber T. Nonlinear Time Series Analysis. Cambridge: Cambridge University Press, 1997 [7] Lv Jin-Hu, Lu Jun-An, Chen Shi-Hua. Chaotic Time Series Analysis and Its Applications. Wuhan: Wuhan University, 2002(吕金虎, 陆君安, 陈士华. 混沌时间序列分析及其应用. 武汉: 武汉大学出版社, 2002) [8] Ali S, Basharat A, Shah M. Chaotic invariants for human action recognition. In: Proceedings of the 11th International Conference on Computer Vision. Rio de Janeiro, Brazil: IEEE, 2007. 1-8 [9] Wu Shan-Dong, Oreifej O, Shah M. Action recognition in videos acquired by a moving camera using motion decomposition of Lagrangian particle trajectories. In: Proceedings of the 2011 International Conference on Computer Vision. Barcelona, Spain: IEEE, 2011. 1414-1426 [10] Liu Song-Tao, Yin Fu-Liang. The basic principle and its new advances of image segmentation methods based on graph cuts. Acta Automatica Sinica, 2012, 38(6): 911-922(刘松涛, 殷福亮. 基于图割的图像分割方法及其新进展. 自动化学报, 2012, 38(6): 911-922) [11] Gorur P, Amrutur B. Speeded up Gaussian mixture model algorithm for background subtraction. In: Proceedings of the 8th International Conference on Advanced Video and Signal Based Surveillance. Klagenfurt, Austria: IEEE, 2011. 386-391 [12] Han Shou-Dong, Zhao Yong, Tao Wen-Bing, Sang Nong. Gaussian super-pixel based fast image segmentation using graph cuts. Acta Automatica Sinica, 2011, 37(1): 11-20(韩守东, 赵勇, 陶文兵, 桑农. 基于高斯超像素的快速Graph Cuts 图像分割方法. 自动化学报, 2011, 37(1): 11-20) [13] Yao Ting-Ting, Xie Zhao. Top-down inference with relabeling and mapping rules in hierarchical MRF for image segmentation. Acta Automatica Sinica, 2013, 39(10): 1581-1593(姚婷婷, 谢昭. 多层次MRF重标记及映射法则下的图像分割. 自动化学报, 2013, 39(10): 1581-1593) [14] Ali S, Shah M. A Lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In: Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, USA: IEEE, 2007. 1-6 [15] Pentland A P. Fractal-based description of natural scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1984, 6(6): 661-674 [16] Chaudhuri B B, Sakar N. Texture segmentation using fractal dimension. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, 17(1): 72-77 [17] Ravichandran A, Chaudhry R, Vidal R. Categorizing dynamic textures using a bag of dynamical systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(2): 342-353 [18] Shroff N, Turaga P, Chellappa R. Moving vistas: exploiting motion for describing scenes. In: Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE, 2010. 1911-1918 [19] Yang Y, Shah M. Complex events detection using data-driven concepts. In: Proceedings of the 12th European Conference on Computer Vision. Berlin, Heidelberg: Springer-Verlag, 2012. 722-735 [20] Takens F. Detecting strange attractors in turbulence. Dynamical Systems and Turbulence. Lecture Notes in Mathematics Volume 898. Berlin: Springer-Verlag, 1981. 366-381 [21] Fraser A M, Swinney H L. Independent coordinates for strange attractors from mutual information. Physical Review A, 1986, 33(2): 1134-1140 [22] Kennel M B, Brown R, Abarbanel H D I. Determining embedding dimension for phase space reconstruction using a geometrical construction. Physical Review A, 1992, 45(6): 3403-3411 [23] Grassberger P, Procaccia I. Characterization of strange attractors. Physical Review Letters, 1983, 50(5): 346-349 [24] Comaniciu D, Meer P. Mean shift: a robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5): 603-619 [25] Saisan P, Doretto G, Wu Y, Soatto S. Dynamic texture recognition. In: Proceedings of the 2001 Computer Society Conference on Computer Vision and Pattern Recognition. Kauai, USA: IEEE, 2001. 58-63 [26] Sandler R, Lindenbaum M. Nonnegative matrix factorization with earth mover’s distance metric for image analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(8): 1590-1602
点击查看大图
计量
- 文章访问数: 1673
- HTML全文浏览量: 48
- PDF下载量: 789
- 被引次数: 0