基于辅助信息的无人机图像批处理三维重建方法

郭复胜; 高伟

doi:10.3724/SP.J.1004.2013.00834

基于辅助信息的无人机图像批处理三维重建方法

doi: 10.3724/SP.J.1004.2013.00834

郭复胜^,,
高伟

1.
中国科学院自动化研究所模式识别国家重点实验室北京 100190

基金项目:

国家重点基础研究发展计划(973计划)(2012CB316302);中国科学院战略性先导科技专项计划(XDA06030300);国家自然科学基金(612 03278)资助

详细信息

通讯作者:
郭复胜

计量
- 文章访问数: 1919
- HTML全文浏览量: 84
- PDF下载量: 2677
- 被引次数: 0
出版历程
- 收稿日期: 2012-04-20
- 修回日期: 2012-07-25
- 刊出日期: 2013-06-20

Batch Reconstruction from UAV Images with Prior Information

GUO Fu-Sheng^,,
GAO Wei

1.
National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190

Funds:

Supported by National Basic Research Program of China(973 Program) (2012CB316302) and the Strategic Priority Research Program of the Chinese Academy of Sciences(XDA06030300), and National Natural Science Foundation of China(61203278)

摘要

摘要: 随着我国低空空域对民用的开放,无人机 (Unmanned aerial vehicles, UAVs)的应用将是一个巨大的潜在市场. 目前,如何对轻便的无人机获取的图像进行全自动处理,是一项急需解决的瓶颈技术. 本文将探索如何将近年来在视频、图像领域获得巨大成功的三维重建技术应用到无人机图像处理领域, 对无人机图像进行全自动的大场景三维重建.本文首先给出了经典增量式三维重建方法Bundler在无人机图像处理中存在的问题, 然后通过分析无人机图像的辅助信息的特点,提出了一种基于批处理重建(Batch reconstruction)框架下的鲁棒无人机图像三维重建方法.多组无人机图像三维重建实验表明: 本文提出的方法在算法鲁棒性、三维重建效率与精度等方面都具有很好的结果.
- 三维重建 /
- 无人机 /
- 批处理重建 /
- 辅助信息
Abstract: With the latest deregulation and opening-up policy of Chinese government on low altitude airspace to private sectors, the applications of unmanned aerial vehicles (UAVs) will be a huge potential market. Currently the automatic processing technology of UAV images is far behind the market demand, and has become the bottleneck of various applications. This work is meant to apply hugely successful scene reconstruction techniques in computer vision field to large scene reconstruction from UAV images. To this end, at first, specific problems of direct application of the Bundler, a popular increment reconstruction technique in computer vision are investigated. Then a batch reconstruction method from UAV images is proposed by fully taking into account various pieces of prior information which are usually available in UAV images, such as those from GPS, IMU, DSM, etc. Our method is tested with several sets of UAV images, and the experiments show that our method performs satisfactorily in terms of robustness, accuracy and scalability for UAV images.
- 3D reconstruction /
- unmanned aerial vehicles (UAVs) /
- batch reconstruction /
- prior information

HTML全文

参考文献(27)

[1]	Cui Hong-Xia, Lin Zong-Jian, Sun Jie. Research on UAV remote sensing system. Bulletin of Surveying and Mapping, 2005, (5): 11-14(崔红霞, 林宗坚, 孙杰. 无人机遥感监测系统研究. 测绘通报, 2005, (5): 11-14)
[2]	Jin Wei, Ge Hong-Li, Du Hua-Qiang, Xu Xiao-Jun. A review on unmanned aerial vehicle remote sensing and its application. Remote Sensing Information, 2009, (1): 88-92(金伟, 葛宏立, 杜华强, 徐小军. 无人机遥感发展与应用概况. 遥感信息, 2009, (1): 88-92)
[3]	Lowe D G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (IJCV), 2004, 60(2): 91-110
[4]	Bay H, Ess A, Tuytelaars T, Van Gool L. Speeded-up robust features (SURF). Computer Vision and Image Understanding, 2008, 110(3): 346-359
[5]	Fischler M A, Bolles R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 1981, 24(6): 381-395
[6]	Rousseeuw P J, Leroy A M. Robust Regression and Outlier Detection. New York: John Wiley and Sons, 1987
[7]	Nister D. An efficient solution to the five-point relative pose problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(6): 756-770
[8]	Hartley R and Hartley, Zisserman A. Multiple View Geometry in Computer Vision (Vol. 2). Cambridge University Press, Cambridge, 2004
[9]	Pollefeys M, Van Gool L, Vergauwen M, Verbiest F, Cornelis K, Tops J, Koch R. Visual modeling with a hand-held camera. International Journal of Computer Vision, 2004, 59(3): 207-232
[10]	Snavely N, Seitz S M, Szeliski R. Photo tourism: exploring photo collections in 3D. ACM Transactions on Graphics (TOG), 2006, 25(3): 835-846
[11]	Strecha C, Pylvänäinen T, Fua P. Dynamic and scalable large scale image reconstruction. In: Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). San Francisco, CA: IEEE, 2010. 406-413
[12]	Hiep V H, Keriven R, Labatut P, Pons J P. Towards high-resolution large-scale multi-view stereo. In: Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Miami, FL: IEEE, 2009. 1430-1437
[13]	Furukawa Y, Ponce J. Accurate, dense, and robust multiview stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8): 1362-1376
[14]	Gherardi R, Farenzena M, Fusiello A. Improving the efficiency of hierarchical structure-and-motion. In: Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). San Francisco, CA: IEEE, 2010. 1594-1600
[15]	Shum H Y, Ke Q F, Zhang Z Y. Efficient bundle adjustment with virtual key frames: a hierarchical approach to multi-frame structure from motion. In: Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). Fort Collins, CO: IEEE, 1999. 538-543
[16]	Martinec D, Pajdla T. Robust rotation and translation estimation in multiview reconstruction. In: Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Minneapolis, MN: IEEE, 2007. 1-8
[17]	Sturm P F, Triggs B. A factorization based algorithm for multi-image projective structure and motion. In: Proceedings of the 4th European Conference on Computer Vision (ECCV). London, UK: Springer-Verlag, 1996. 709-720
[18]	Tomasi C, Kanade T. Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision (IJCV), 1992, 9(2): 137-154
[19]	Kahl F, Hartley R I. Multiple-view geometry under the L∞ norm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 30(9): 1603-1617
[20]	Sim K, Hartley R. Recovering camera motion using L∞ minimization. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). Washington, DC: IEEE, 2006. 1230-1237
[21]	Li Li-Chun, Zhang Heng, Li You, Yu Qi-Feng. A 3D landform reconstruction method based on UAV image sequences. Remote Sensing Technology and Application, 2008, 23(5): 505-510(李立春, 张恒, 李由, 于起峰. 一种基于无人机序列成像的地形地貌重建方法. 遥感技术与应用, 2008, 23(5): 505-510)
[22]	Qiu Zhi-Qiang. Three-Dimensional Structure Reconstruction from Aerial Images Based on Affine Approximation [Ph.D. dissertation], National University of Defense Technology, China, 2004(邱志强. 基于仿射近似从航空图像重建目标三维结构 [博士学位论文], 国防科学技术大学, 中国, 2004)
[23]	Shen Yong-Lin, Liu Jun, Wu Li-Xin, Li Fa-Shuai, Wang Zhi. Reconstruction of disaster scene from UAV images and flight-control data. Geography and Geo-Information Science, 2011, 27(6): 13-17(沈永林, 刘军, 吴立新, 李发帅, 王植. 基于无人机影像和飞控数据的灾场重建方法研究. 地理与地理信息科学, 2011, 27(6): 13-17)
[24]	Irschara A, Hoppe C, Bischof H, Kluckner S. Efficient structure from motion with weak position and orientation priors. In: Proceedings of the 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR). Colorado Springs, CO: IEEE, 2011. 21-28
[25]	Snavely K N. Scene Reconstruction and Visualization from Internet Photo Collections [Ph.D. dissertation], University of Washington, USA, 2008
[26]	Sinha S N, Frahm J M, Pollefeys M, Genc Y. Feature tracking and matching in video using programmable graphics hardware. Machine Vision and Applications, 2011, 22(1): 207-217
[27]	Wu C C, Agarwal S, Curless B, Seitz S M. Multicore bundle adjustment. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Providence, RI: IEEE, 2011. 3057-3064