Non-rigid Tracking Method Based on Layered Elastic Motion Analysis
-
摘要: 采用时--空分层的弹性运动跟踪策略, 提出了一种分析长时运动稳定结构与短时运动局部变化的非刚体运动跟踪方法. 首先, 基于序贯形状聚类的分段弹性运动跟踪模型, 将整段图像序列分割成若干子段, 并利用弹性运动分析方法得到子段内各帧边缘点的对应关系和各类的平均形状, 获取短时局部运动变化细节. 然后, 通过基于贝叶斯网的整体搜索算法寻找时序上相邻聚类平均形状之间的对应关系, 进而得到整段运动的公共形状, 用于表示长时运动稳定结构. 通过计算公共形状与各类平均形状之间的变形关系, 可以建立各聚类平均形状之间的对应关系, 实现分段运动的连接. 本方法的特点是不依赖先验模型、 通用性好、 目标的描述能力强. 实验表明, 本方法与现有不依赖模型的方法相比,具有更好的长时稳定性和更高的跟踪精确度.Abstract: In this paper, we present a spatial-temporal layered elastic motion tracking method to estimate long-term stable structures and short-term local motions for non-rigid targets. First, the sequence is segmented into several pieces by sequential shape clustering based a piece-wise elastic motion tracking model, the correspondence among frames in the same segment and the mean shape of all clusters are calculated by piece-wise elastic motion tracking. Then, we use a Bayesian network based global search method to find the correspondence of mean shapes of adjoining clusters and extract the common shape of the entire sequence. The proposed method, which does not require prior shape models, is adaptive to and descriptive for general objects. The experiments on non-rigid targets validate both the long-term stability and the detailed accuracy of our proposed method.
-
[1] Gavrila D M. The visual analysis of human movement: a survey. Computer Vision and Image Understanding, 1999, 73(1): 82-98 [2] [2] Aggarwal J K, Cai Q. Human motion analysis: a review. Computer Vision and Image Understanding, 1999, 73(3): 428-440 [3] [3] Cootes T F, Taylor C J, Cooper D H, Graham J. Active shape models-their training and application. Computer Vision and Image Understanding, 1995, 61(1): 38-59 [4] [4] Cootes T F. Deformable object modelling and matching. In: Proceedings of the 10th Asian Conference on Computer Vision. Berlin, Heidelberg: Springer-Verlag, 2010. 1-10 [5] [5] Huang X L, Zhang S, Wang Y, Metaxas D, Saamaras D. A hierarchical framework for high resolution facial expression tracking. In: Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop. Washington D.C., USA: IEEE, 2004. 22 [6] [6] Aggarwal J K, Cai Q, Liao W, Sabata B. Nonrigid motion analysis: articulated and elastic motion. Computer Vision and Image Understanding, 1998, 70(2): 142-156 [7] [7] Sundaram N, Brox T, Keutzer K. Dense point trajectories by GPU-accelerated large displacement optical flow. In: Proceedings of the 11th European Conference on Computer Vision. Berlin, Heidelberg: Springer-Verlag, 2010. 438-451 [8] [8] Brox T, Malik J. Large displacement optical flow: descriptor matching in variational motion estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(3): 500-513 [9] [9] Dollar P, Rabaud V, Cottrell G, Belongie S. Behavior recognition via sparse spatio-temporal features. In: Proceedings of the 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance. Washington D.C., USA: IEEE, 2005. 65-72 [10] Liu T, Yuan Z J, Sun J, Wang J D, Zheng N N, Tang X O, Shum H Y. Learning to detect a salient object. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(2): 353-367 [11] Mahadevan V, Vasconcelos N. Saliency-based discriminant tracking. In: Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, FL: IEEE, 2009. 1007-1013 [12] Di H J, Tao L M, Xu G Y. A mixture of transformed hidden Markov models for elastic motion estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31(10): 1817-1830 [13] Cheng H T, Ahuja N. Exploiting nonlocal spatiotemporal structure for video segmentation. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI: IEEE, 2012. 741-748 [14] Li F X, Kim T, Humayun A, Tsai D, Rehg J. Video segmentation by tracking many Figure-Ground segments. In: Proceedings of the 2013 Computer Vision. Sydney, NSW: IEEE, 2013. 2191-2199 [15] Shapiro L, Wang H, Brady J. A matching and tracking strategy for independently moving objects. British Machine Vision Conference, 1992. [16] Tagare H D. Shape-based nonrigid correspondence with application to heart motion analysis. IEEE Transactions on Medical Imaging, 1999, 18(7): 570-579 [17] Cootes T F, Edwards G J, Taylor C J. Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(6): 681-685 [18] Matthews I, Baker S. Active appearance models revisited. International Journal of Computer Vision, 2004, 60(2): 135-164 [19] Duta N, Jain A K, Dubuisson-Jolly M P. Automatic construction of 2D shape models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(5): 433-446 [20] Huang X L, Paragios N, Metaxasm D N. Shape registration in implicit spaces using information theory and free form deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(8): 1303-1318 [21] Paragios N, Rousson M, Ramesh V. Non-rigid registration using distance functions. Computer Vision and Image Understanding, 2003, 89(2-3): 142-165 [22] Besl P J, McKay N D. A method for registration of 3d shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 239-256 [23] Fitzgibbon A. Robust registration of 2D and 3D point sets. Image and Vision Computing, 2003, 21(13): 1145-1153 [24] Chui H L, Rangarajan A. A new point matching algorithm for non-rigid registration. Computer Vision and Image Understanding, 2003, 89(2-3): 114-141 [25] Chui H, Rangarajan A, Zhang J, Leonard C M. Unsupervised learning of an atlas from unlabeled point-sets. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(2): 160-172 [26] Qi Y J, Hauptmann A, Liu T. Supervised classification for video shot segmentation. In: Proceedings of the 2003 International Conference on Multimedia and Expo. Washington D.C., USA: IEEE, 2003. 689-692 [27] Wang Liang, Hu Wei-Ming, Tan Tie-Niu. A survey of visual analysis of human motion. Chinese Journal of Computers, 2002, 25(3): 225-237(王亮, 胡卫明, 谭铁牛. 人运动的视觉分析综述. 计算机学报, 2002, 25(3): 225-237) [28] Ye Hang-Jun, Bai Xue-Sheng, Xu Guang-You. Face pose discrimination with support vector machines. Journal of Tsinghua University (Science and Technology), 2003, 43(1): 67-70(叶航军, 白雪生, 徐光祐. 基于支持向量机的人脸姿态判定. 清华大学学报(自然科学版), 2003, 43(1): 67-70)
点击查看大图
计量
- 文章访问数: 1416
- HTML全文浏览量: 34
- PDF下载量: 1008
- 被引次数: 0