1.桂林电子科技大学 机电工程学院 广西制造系统与先进制造技术重点实验室,桂林 541000
2.桂林凯文彼德科技有限公司,桂林 541001
3.苏州大学 数字成像与显示教育部工程研究中心,苏州 215006
刘规杰,2917347458@qq.com
李文杰,li-wenjie@163.com
收稿:2025-11-04,
修回:2025-12-29,
录用:2026-01-16,
纸质出版:2026-03-25
移动端阅览
刘规杰,刘伍浪,李明枫,等. 一种基于多任务网络的条纹投影轮廓术相位恢复方法[J].光子学报,2026,55(3):0311001
LIU Guijie, LIU Wulang, LI Mingfeng, et al. A Phase Recovery Method for Fringe Projection Profilometry Based on Multi-task Networks[J]. Acta Photonica Sinica, 2026, 55(3):0311001
刘规杰,刘伍浪,李明枫,等. 一种基于多任务网络的条纹投影轮廓术相位恢复方法[J].光子学报,2026,55(3):0311001 DOI: 10.3788/gzxb20265503.0311001. CSTR: 32255.14.gzxb20265503.0311001.
LIU Guijie, LIU Wulang, LI Mingfeng, et al. A Phase Recovery Method for Fringe Projection Profilometry Based on Multi-task Networks[J]. Acta Photonica Sinica, 2026, 55(3):0311001 DOI: 10.3788/gzxb20265503.0311001. CSTR: 32255.14.gzxb20265503.0311001.
基于一种多任务网络,仅用单幅条纹图像实现包裹相位计算和条纹级次获取,继而直接获得展开相位。所设计网络模型以UNet为基础架构,引入残差模块,增强特征提取能力与训练稳定性。同时,所提模型结合信息收集与分发机制,实现多分支预测任务,直接输出包裹相位的分子项、分母项以及条纹级次,避免多个网络模型使用带来的繁琐、耗时问题。同时,充分利用包裹相位分布信息,构建条纹级次一致性连通域,以提高条纹级次分类的稳定性。实验结果表明,所提方法可实现精确、快速的相位信息恢复,并具有较好的泛化能力。
3D reconstruction techniques have been extensively applied across a wide range of fields in recent years, including medical imaging, robotic navigation, virtual and augmented reality, 3D animation modeling, and online product inspection. Among these techniques, Fringe Projection Profilometry (FPP) has attracted significant attention owing to its non-contact measurement capability, full-field acquisition, and high spatial resolution. These advantages have led to its widespread adoption in industrial inspection, cultural heritage preservation, biomedical applications, and reverse engineering. Within an FPP system, phase recovery constitutes a fundamental and indispensable step, as both the accuracy and computational efficiency of phase estimation directly determine the quality of the reconstructed 3D surface and the overall system performance. Consequently, the development of fast, accurate, and robust phase recovery methods remains a central research topic in fringe projection profilometry.
Traditional phase retrieval techniques mainly include Fourier Transform Profilometry (FTP) and multi-step Phase-Shifting Profilometry (PSP). Multi-step phase-shifting methods achieve high phase accuracy by projecting and capturing multiple phase-shifted fringe patterns; however, their reliance on multiple frames significantly restricts their applicability in dynamic scenes or high-speed measurement scenarios. In contrast, Fourier transform-based methods can extract phase information from a single fringe image, offering improved measurement efficiency. Nevertheless, their performance tends to degrade considerably when dealing with complex surface geometries, depth discontinuities, severe noise, or strong surface reflectivity, resulting in reduced accuracy and robustness. In recent years, researchers have increasingly integrated deep learning with phase extraction and phase unwrapping processes, achieving high reconstruction accuracy while significantly reducing the number of required projection patterns. Compared with conventional analytical approaches, deep learning-based methods exhibit superior capability in handling noise, nonlinear distortions, and surface discontinuities. Despite these advantages, existing deep learning-based absolute phase recovery methods still suffer from several limitations. Existing deep learning-based absolute phase recovery methods mainly fall into two categories. The first predicts the numerator and denominator terms of wrapped phase at three different frequencies separately, then computes the absolute phase using multi-frequency or number-theoretic methods. The second employs either a dual-network or dual-decoding architecture to separately predict the numerator and denominator terms of the high-frequency wrapped phase along with the fringe order, thereby obtaining the absolute phase. The former suffers from error accumulation during multi-frequency unwrapping, leading to significant inaccuracies and poor stability. The latter incurs high computational complexity and low inference efficiency due to the multi-network or dual-decoder design.
Aiming to address the issues of error accumulation and high model complexity inherent in existing methods, this paper proposes a novel multi-task phase recovery framework based on GD-UNet (UNet with an Information Gather-and-Distribute Mechanism). The proposed method enables simultaneous prediction of the wrapped phase and fringe order within a single network, thereby allowing direct recovery of the absolute phase. Built upon the classical UNet architecture, the proposed model incorporates residual modules to enhance feature extraction capability and improve training stability. In addition, by integrating an information gather-and-distribute mechanism, the network supports multi-task learning and directly outputs the numerator and denominator of the wrapped phase as well as the corresponding fringe order. This unified design eliminates the need for multiple networks, effectively reducing computational complexity and inference time. Furthermore, to enhance the robustness of fringe order prediction-particularly in challenging regions such as object boundaries, sharp depth discontinuities, and highly reflective surfaces-a fringe order correction strategy based on Connected Domain Segmentation (CDS) of the wrapped phase is introduced. The proposed CDS-based correction method exploits the spatial continuity of the wrapped phase, under the assumption that all pixels within the same connected domain theoretically share an identical fringe order. Since prediction errors tend to occur more frequently near domain boundaries, the final fringe order for each connected region is determined through majority voting, thereby effectively suppressing local misclassifications. This strategy significantly improves the stability and accuracy of fringe order estimation without introducing additional computational burden. Extensive experiments are conducted to evaluate the performance of the proposed method under various conditions, including different surface materials, complex geometries, and discontinuous scenes. Both quantitative and qualitative comparisons with state-of-the-art methods demonstrate that the proposed GD-UNet-based framework achieves superior phase recovery accuracy while maintaining lower model complexity and faster inference speed.
The experimental results indicate that the proposed approach effectively mitigates error accumulation, enhances robustness against noise and surface reflectivity, and exhibits strong generalization capability across diverse measurement scenarios. In conclusion, this paper aims to achieve stable and high-precision phase recovery from a single fringe image in complex scenes containing large surface discontinuities or isolated objects through a unified network model. A single-frame phase extraction method is presented, in which only one fringe image is required, and a single network simultaneously predicts the numerator and denominator of the wrapped phase as well as the fringe order map. The proposed approach demonstrates clear advantages in both accuracy and efficiency. Comprehensive experimental evaluations confirm that the method achieves excellent measurement accuracy and strong robustness in challenging scenarios, including complex surface reconstruction, high noise interference, and multi-material object measurement.
HE K , LIU X , LIU J , et al . A multitask learning-based neural network for defect detection on textured surfaces under weak supervision [J]. IEEE Transactions on Instrumentation and Measurement , 2021 , 70 : 1 - 14 .
YU Jiajie , ZHOU Jianping , XUE Ruilei , et al . Weld surface quality detection based on structured light and illumination model [J]. Chinese Journal of Lasers , 2022 , 49 ( 16 ): 170 - 178 .
余佳杰 , 周建平 , 薛瑞雷 , 等 . 基于结构光视觉和光照模型的焊缝表面质量检测 [J]. 中国激光 , 2022 , 49 ( 16 ): 170 - 178 . DOI: 10.3788/CJL202249.1602019 http://dx.doi.org/10.3788/CJL202249.1602019
WU Fupei , PENG Junlong , YE Weilin , et al . A printed circuit board three-dimensional reconstruction method based on fringe phase characteristics [J]. Acta Optica Sinica , 2024 , 44 ( 14 ): 152 - 161 .
吴福培 , 彭俊龙 , 叶玮琳 , 等 . 一种基于条纹相位特征的印刷电路板三维重建方法 [J]. 光学学报 , 2024 , 44 ( 14 ): 152 - 161 . DOI: 10.3788/AOS240739 http://dx.doi.org/10.3788/AOS240739
GENG J . Structured-light 3D surface imaging: a tutorial [J]. Advances in Optics and Photonics , 2011 , 3 ( 2 ): 128 - 160 .
HAN Hexiang , GAO Nan , ZHANG Guofeng , et al . Three-dimensional morphology measurement of highly reflective objects based on three channel parallel processing [J]. Acta Photonica Sinica , 2024 , 53 ( 7 ): 0712003 .
韩鹤翔 , 高楠 , 张国锋 , 等 . 基于三通道并行的高反光物体三维形貌测量 [J]. 光子学报 , 2024 , 53 ( 7 ): 0712003 .
ZHANG Wei , CHEN Yuchong , YAO Pengcheng , et al . Three-dimensional measurement of complex textured objects based on bidirectional fringe projection [J]. Acta Optica Sinica , 2024 , 44 ( 9 ): 101 - 112 .
张巍 , 陈玉翀 , 姚鹏程 , 等 . 基于双向条纹投影的复杂纹理物体三维测量 [J]. 光学学报 , 2024 , 44 ( 9 ): 101 - 112 . DOI: 10.3788/aos240508 http://dx.doi.org/10.3788/aos240508
XIA R , ZHAO J , ZHANG T , et al . Detection method of manufacturing defects on aircraft surface based on fringe projection [J]. Optik , 2020 , 208 : 164332 .
GUO Wenbo , ZHANG Qican , WU Zhoujie . Real-time three dimensional imaging technique based on phase-shift fringe analysis: a review [J]. Laser & Optoelectronics Progress , 2021 , 58 ( 8 ): 0800001 .
郭文博 , 张启灿 , 吴周杰 . 基于相移条纹分析的实时三维成像技术发展综述 [J]. 激光与光电子学进展 , 2021 , 58 ( 8 ): 0800001 . DOI: 10.3788/LOP202158.0800001 http://dx.doi.org/10.3788/LOP202158.0800001
VAN DER JEUGHT S , DIRCKX J J J . Real-time structured light profilometry: a review [J]. Optics and Lasers in Engineering , 2016 , 87 : 18 - 31 .
WU Z , ZHANG Q . High-speed 3D topography measurement based on fringe projection: a review [J]. Laser & Optoelectronics Progress , 2023 , 60 ( 8 ): 0811001 .
LI Z , WANG J , JI Y , et al . Fringe projection profilometry based on deep learning phase demodulation combined with temporal phase unwrapping [J]. Applied Physics B , 2024 , 130 ( 12 ): 213 .
NGUYEN A H , SUN B , LI C Q , et al . Different structured-light patterns in single-shot 2D-to-3D image conversion using deep learning [J]. Applied Optics , 2022 , 61 ( 34 ): 10105 - 10115 .
FENG S , CHEN Q , GU G , et al . Fringe pattern analysis using deep learning [J]. Advanced Photonics , 2019 , 1 ( 2 ): 025001 .
YIN W , CHE Y , LI X , et al . Physics-informed deep learning for fringe pattern analysis [J]. Opto-Electronic Advances , 2024 , 7 ( 1 ): 230034 .
LI Y , QIAN J , FENG S , et al . Deep-learning-enabled dual-frequency composite fringe projection profilometry for single-shot absolute 3D shape measurement [J]. Opto-Electronic Advances , 2022 , 5 ( 5 ): 210021 .
SHI J , ZHU X , WANG H , et al . Label enhanced and patch based deep learning for phase retrieval from single frame fringe pattern in fringe projection 3D measurement [J]. Optics Express , 2019 , 27 ( 20 ): 28929 - 28943 .
QIAN J , FENG S , LI Y , et al . Single-shot absolute 3D shape measurement with deep-learning-based color fringe projection profilometry [J]. Optics Letters , 2020 , 45 ( 7 ): 1842 - 1845 .
LI J , ZHANG K , LUO L , et al . Deep-learning-enabled single-shot fringe projection profilometry based on inner shifting-phase encoding [J]. Optics Express , 2025 , 33 ( 23 ): 49530 - 49550 .
NGUYEN A H , LY K L , LAM V K , et al . Generalized fringe-to-phase framework for single-shot 3D reconstruction integrating structured light with deep learning [J]. Sensors , 2023 , 23 ( 9 ): 4209 .
TAN H , XU Y , ZHANG C , et al . A Y-shaped network based single-shot absolute phase recovery method for fringe projection profilometry [J]. Measurement Science and Technology , 2023 , 35 ( 3 ): 035203 .
RONNEBERGER O , FISCHER P , BROX T . U-net: Convolutional networks for biomedical image segmentation [C]. Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015 , 2015 : 234 - 241 .
ZUO C , HUANG L , ZHANG M , et al . Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review [J]. Optics and Lasers in Engineering , 2016 , 85 : 84 - 103 .
LI W , SUN H , LI F , et al . A complementary binary code based phase unwrapping method [J]. Optoelectronics Letters , 2024 , 20 ( 4 ): 228 - 233 .
YU H , CHEN X , ZHANG Z , et al . Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning [J]. Optics Express , 2020 , 28 ( 7 ): 9405 - 9418 .
0
浏览量
8
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010602201714号