作者：屈玉福, 章平

作者单位：北京航空航天大学仪器科学与光电工程学院, 北京 100191

关键词：显微镜;多视角;PMVS;三维重建;三维检测

摘要：

为获得微小器件的三维形貌，该文利用单视旋转显微镜通过旋转被测物体或成像系统采集被测物体的多角度图像序列，应用多视三维重建算法处理序列图像。通过改进宏观视觉领域基于面片的立体视觉方法，实现单目旋转视频显微镜的被测工件三维重建技术；并根据物体相对于相机倾斜角度的范围来细化扩展半径，增加原算法中的扩展方向，针对扩展面片法向量相对于相机角度的不同，设置不同扩展半径和扩展次数，解决重建过程中物体90垂直侧面重建面片成条状和稀疏的问题。实验结果表明：通过改进算法，相同的显微镜图像序列进行三维重建的点个数增加2.2倍；同时对于物体侧面等垂直表面处，重建表面的漏洞和分层问题有明显的改善，最小相对测量误差达0.44%。

Research on 3D measurement technology of single-view rotating microscope

QU Yufu, ZHANG Ping

School of Instrument Science and Opto-electronics Engineering, Beihang University, Beijing 100191, China

Abstract: In order to get three dimensional morphology of micro devices, bright-field optical microscope is used to capture multi-view image sequences by rotating the micro object or the imaging system, and the multi-view three-dimensional(3D) reconstruction algorithm is used for image sequences. By improving patch-based multi-view stereo (PMVS) in macroscopic visual field, three-dimensional reconstruction technology for detected workpiece of single-view rotating video microscope is achieved. Besides, expansion radius is detailed and the expansion directions in original algorithm are increased according to the range of inclination angle of object relative to camera. Based on the condition that vector of expansion patch-based method is different from camera angle, different expansion radius and times are set to solve the problem that reconstruction face of 90° vertical side of object is in stripe shape and sparse. Test results show that the number of 3D reconstruction points of same microscope images sequence is increased for 2.2 times by improving algorithm, and the loopholes and delamination on reconstruction surface of the vertical side of object are obviously improved with minimum relative measuring error reaching 0.44%.

Keywords: microscope;multi-view;PMVS;3D reconstruction;3D detection

2018, 44(3): 1-5  收稿日期: 2017-10-21;收到修改稿日期: 2017-11-29

基金项目: 国家自然科学基金项目（51675033）

作者简介: 屈玉福(1976-),男,陕西靖边县人,副教授,主要从事计算成像、机器视觉检测技术的研究。

参考文献

[1] PERTUZ S, PUIG D, GARCIA M A. Analysis of focus measure operators for shape-from-focus[J]. Pattern Reco-gnition,2013,46(5):1415-1432.
[2] BEN-ARI R, RAVEH G. Variational depth from defocus in real-time[C]//Proceedings of the IEEE International Conference on Computer Vision Workshops,2011.
[3] MOELLER M, BENNING M, SCHONLIEB C, et al. Variational depth from focus reconstruction[J]. IEEE Transactions on Image Processing,2015,24(12):5369-5378.
[4] HASLER M, HAIST T, OSTEN W. Stereo vision in spatial-light-modulator-based microscopy[J]. Opt Lett,2012,37(12):2238-2240.
[5] 王跃宗. SLM显微立体视觉量化和三维数据重构研究[D].大连:大连理工大学,2003.
[6] MA S J, QU Y F. 3D reconstruction of rotational video microscope based on patches[C]//Photoelectric Technology Committee Conferences,2015.
[7] ZHAI B B, LIU S, JIN H Q, et al. A Novel framework of motion error evaluation and correction for monocular microscopic visual system[C]//Chinese Conference on Pattern Recognition,2012.
[8] 翟斌斌. 基于显微视觉的旋转图像序列三维重建技术研究[D]. 杭州:浙江工业大学,2013.
[9] SNAVELY N, SEITZ S M, SZELISKI R. Photo tourism:exploring photo collections in 3D[C]//SIGGRAPH International Conference on Computer Graphics and Interactive Techniques,2006.
[10] AMMI M, FREMONT V, FERREIRA A. Automatic ca-mera-based microscope calibration for a telemicromanipulation system using a virtual pattern[J]. IEEE Transac-tions on Robotics,2009,25(1):184-191.
[11] 许红梅. 用于微装配的显微视觉系统标定技术的研究[D].重庆:重庆大学,2011.
[12] 王文强. 显微视觉定位系统中摄像机标定技术研究[D]. 大连:大连理工大学,2013.