Dense Multi-planar Scene Reconstruction from Sparse Point Cloud
-
摘要: 多平面场景是生活中常见的一种场景,然而由于该类场景中常常存在物体表面纹理缺乏和纹理重复的现象,导致从多视图像重建获得的三维点云数据中存在点云过于稀疏甚至孔洞等问题,进而导致以微面片拟合三维点云所得到的重建表面出现平面颠簸现象.针对这些问题,本文提出了一种基于稀疏点云的分段平面场景重建方法.首先,利用分层抽样代替随机抽样,改进了J-Linkage多模型估计算法;然后,利用该方法对稀疏点云进行多平面拟合,来获得场景的多平面模型;最后,将多平面模型和无监督的图像分割相结合,提取并重建场景中的平面区域.场景中的非平面部分用CMVS/PMVS(Clustering views for multi-view stereo/patch-based multi-view stereo)算法重建.多平面模型估计的实验表明,改进的J-Linkage算法提高了模型估计的准确度.三维重建的实验证实,提出的重建方法在有效地克服孔洞和平面颠簸问题的同时,还能重建出完整平面区域.Abstract: There are multi-planar scenes everywhere in our daily life. However, given its lack and self-repeat of the texture, there would be problems of over scarcity and holes on the reconstructed point cloud by the method of multi-view reconstruction. Further, there would be vacillation over the reconstructed facades using the method of fitting the reconstructed point cloud with miniature facets. To address these problems, we propose a method of piecewise reconstruction of each plane from the sparse point cloud. The proposed method first improves the J-linkage algorithm, with the stratified sampling instead of the random sampling. We then fit the point cloud with planes using the improved J-linkage algorithm, to obtain the multi-planar model of the scene. Finally, we extract and reconstruct the planar regions with the multi-planar model as well as an unsupervised segmentation algorithm. Besides, the non-planar areas are reconstructed by using the clustering views for multi-view stereo/patch-based multi-view stereo(CMVS/PMVS) algorithm. Experimental results of the multi-planar model demonstrate that the improved J-linkage algorithm can enhance the accuracy of the multi-planar model. Also, the experimental results of 3D reconstruction show that our method not only can effectively overcome holes and jaggies problems, but also can model the complete planar regions.
-
[1] Vanegas C A, Aliaga D G, Wonka P, Mller P, Waddell P, Watson B. Modelling the appearance and behaviour of urban spaces. Computer Graphics Forum, 2010, 29(1):25-42 [2] [2] Sheppard S R J, Cizek P. The ethics of Google Earth:crossing thresholds from spatial data to landscape visualisation. Journal of Environmental Management, 2009, 90(6):2012-2117 [3] Shi Li-Min, Guo Fu-Sheng, Hu Zhan-Yi. An improved PMVS through scene geometric information. Acta Automatica Sinica, 2011, 37(5):560-568(史利民, 郭复胜, 胡占义. 利用空间几何信息的改进PMVS算法. 自动化学报, 2011, 37(5):560-568) [4] [4] Simon L, Teboul O, Koutsourakis P, Van Gool L, Paragios N. Parameter-free/Pareto-driven procedural 3D reconstruction of buildings from ground-level sequences. In:Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Rhode Island, USA:IEEE, 2012. 518-525 [5] [5] Vanegas C A, Aliaga D G, Benes B. Automatic extraction of manhattan-world building masses from 3D laser range scans. IEEE Transactions on Visualization and Computer Graphics, 2012, 18(10):1627-1637 [6] [6] Agarwal S, Furukawa Y, Snavely N, Simon I, Curless B, Seitz S M, Szeliski R. Building rome in a day. In:Proceedings of the 12th International Conference on Computer Vision. Kyoto, Japan:IEEE, 2009. 72-79 [7] [7] Mičuk B, Koeck J. Multi-view superpixel stereo in urban environments. International Journal of Computer Vision, 2010, 89(1):106-119 [8] [8] Snavely N, Simon I, Goesele M, Szeliski R, Seitz S M. Scene reconstruction and visualization from community photo collections. Proceedings of the IEEE, 2010, 98(8):1370-1390 [9] [9] Bartoli A, Sturm P. Constrained structure and motion from multiple uncalibrated views of a piecewise planar scene. International Journal of Computer Vision, 2003, 52(1):45-64 [10] Zhou Z H, Jin H L, Ma Y. Robust plane-based structure from motion. In:Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Rhode Island, USA:IEEE, 2012. 1482-1489 [11] Goesele M, Snavely N, Curless B, Hoppe H, Seitz S M. Multi-view stereo for community photo collections. In:Proceedings of the 11th International Conference on Computer Vision. Rio de Janeiro, Brazil:IEEE, 2007. 1-8 [12] Seitz S M, Curless B, Diebel J, Scharstein D, Szeliski R. A comparison and evaluation of multi-view stereo reconstruction algorithms. In:Proceedings of the 2006 IEEE Conference on Computer Vision and Pattern Recognition. Washington D.C., USA:IEEE, 2006. 519-528 [13] Furukawa Y, Ponce J. Accurate, dense, and robust multiview stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8):1362-1376 [14] Musialski P, Wonka P, Aliaga D G, Wimmer M, Gool L, Purgathofer W. A survey of urban reconstruction. In Computer Graphics Forum, 2013, 32(6):146-177 [15] Bartoli A. A random sampling strategy for piecewise planar scene segmentation. Computer Vision and Image Understanding, 2007, 105(1):42-59 [16] Yu W C, Kai L Y, Chung P C. 3D reconstruction of piecewise planar models from multiple views utilizing coplanar and region constraints. Journal of Information Science and Engineering, 2013, 29(2):361-378 [17] Micusik B, Kosecka J. Piecewise planar city 3D modeling from street view panoramic sequences. In:Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, USA:IEEE, 2009. 2906-2912 [18] Sinha S N, Steedly D, Szeliski R. Piecewise planar stereo for image-based rendering. In:Proceedings of the 12th IEEE Conference on Computer Vision. Rio de Kyoto, Japan:IEEE, 2009. 1881-1888 [19] Gallup D, Frahm J M, Pollefeys M. Piecewise planar and non-planar stereo for urban scene reconstruction. In:Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA:IEEE, 2010. 1418-1425 [20] Hane C, Zach C, Cohen A, Angst R, Pollefeys M. Joint 3D scene reconstruction and class segmentation. In:Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland, USA:IEEE, 2013. 97-104 [21] Toldo R, Fusiello A. Photo-consistent planar patches from unstructured cloud of points. In:Proceedings of the 2010 European Conference on Computer Vision. Crete, Greece:Springer, 2010. 589-602 [22] Toldo R, Fusiello A. Robust multiple structures estimation with J-linkage. In:Proceedings of the 2008 European Conference on Computer Vision. Marseille, France:Springer, 2008. 537-547 [23] Zuliani M, Kenney C S, Manjunath B S. The multiransac algorithm and its application to detect planar homographies. In:Proceedings of the 2005 IEEE Conference on Image Processing. Genoa, Italy:IEEE, 2005. 153-156 [24] Veksler O. Star shape prior for graph-cut image segmentation. In:Proceedings of the 2008 European Conference on Computer Vision. Marseille, France:Springer, 2008. 454-467 [25] Gulshan V, Rother C, Criminisi A, Blake A, Zisserman A. Geodesic star convexity for interactive image segmentation. In:Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA:IEEE, 2010. 3129-3136 [26] Farenzena M, Fusiello A, Gherardi R. Structure-and-motion pipeline on a hierarchical cluster tree. In:Proceedings of the 12th IEEE Conference on Computer Vision Workshops. Miami, USA:IEEE, 2009. 1489-1496
点击查看大图
计量
- 文章访问数: 3798
- HTML全文浏览量: 352
- PDF下载量: 2651
- 被引次数: 0