Modulation-Guided and Digital Twin-Driven 3D Measurement Method for Highly Reflective Surfaces

ZHANG Boxia; FU Shuai; GAO Nan; MENG Zhaozong; ZHANG Zonghua

doi:10.3788/gzxb20265508.0812002

Chinese

您当前的位置：

首页 >

文章列表页 >

Modulation-Guided and Digital Twin-Driven 3D Measurement Method for Highly Reflective Surfaces

更新时间：2026-07-15

- Modulation-Guided and Digital Twin-Driven 3D Measurement Method for Highly Reflective Surfaces
- Acta Photonica Sinica Pages: 1-17(2026)
- 作者机构：
  
  河北工业大学机械工程学院，天津 300130
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China(U2341275);Scientific Research Project of Education Department of Hebei Province(JZX2024021)
- DOI：10.3788/gzxb20265508.0812002
  CLC： TH741
- CSTR：32255.14.gzxb20265508.0812002
- Received：16 April 2026，
  
  Revised：2026-05-21，
  
  Accepted：25 May 2026，
- 稿件说明：
移动端阅览
张伯夏，付帅，高楠，等. 基于调制引导与数字孪生驱动的高反光表面三维测量方法［J］.光子学报，2026，55（8）：0812002

ZHANG Boxia， FU Shuai， GAO Nan， et al. Modulation-Guided and Digital Twin-Driven 3D Measurement Method for Highly Reflective Surfaces［J］. Acta Photonica Sinica， 2026， 55（8）：0812002
张伯夏，付帅，高楠，等. 基于调制引导与数字孪生驱动的高反光表面三维测量方法［J］.光子学报，2026，55（8）：0812002 DOI： 10.3788/gzxb20265508.0812002. CSTR： 32255.14.gzxb20265508.0812002.

ZHANG Boxia， FU Shuai， GAO Nan， et al. Modulation-Guided and Digital Twin-Driven 3D Measurement Method for Highly Reflective Surfaces［J］. Acta Photonica Sinica， 2026， 55（8）：0812002 DOI： 10.3788/gzxb20265508.0812002. CSTR： 32255.14.gzxb20265508.0812002.

摘要

针对结构光三维测量中金属表面高反射导致的条纹饱和、调制信息缺失及相位解算失真问题，提出一种基于数字孪生数据驱动的调制引导注意力网络的三维重建方法。首先，构建了面向高反光场景的数字孪生条纹投影系统，生成具有多样反射特性的高动态范围虚拟数据集，解决了真实场景下数据采集成本高、标注困难的局限性。其次，设计一种融合多尺度残差编码、全局特征感知及调制引导模块的调制引导注意力网络，将条纹梯度与调制幅值作为空间先验信息引入注意力机制，引导网络自适应地滤除高反光区域的无效干扰，并对缺失的条纹信息进行精确特征重构，从而仅利用单幅受干扰的条纹图像即可稳定预测出理想的正弦与余弦分量。实验结果表明，在198mm×152mm的有效视场下，所提方法在处理高反光表面时效果良好，虚拟测试集平均绝对误差为0.0083 mm；在实际金属台阶测量中，最大绝对误差为0.032 mm。与现有的深度学习网络相比，该方法在重建精度上具有显著优势，且在大幅提升测量效率的前提下达到了与传统多重曝光法相当的精度水平，为高反射工业零件的高速、高精度三维测量提供了有效方案。

Abstract

Objective

The objective of this study is to address the critical challenges encountered in structured light three-dimensional （3D） measurement of highly reflective metallic surfaces， specifically the issues of fringe pattern saturation， loss of modulation information， and subsequent phase unwrapping distortion. To overcome these limitations， this paper proposes a novel 3D reconstruction method based on a modulation-guided attention network driven by digital twin data. The primary goal is to achieve robust， high-precision phase recovery and 3D shape reconstruction under high dynamic range （HDR） conditions using only a single degraded fringe image per spatial frequency. This approach is designed to eliminate the heavy dependence on traditional multi-exposure acquisition techniques and complex phase-shifting sequences while strictly maintaining optimal measurement accuracy.

关键词

Keywords

references

HUANG Yiyang ， WANG Jie ， SONG Yiping ， et al . A novel defect detection method with eliminating dust for specular surfaces based on structured-light modulation analysis technique ［J］. Optics and Laser Technology ， 2021 ， 141 ： 107089 .

LU Lilian ， WU Zhoujie ， ZHANG Qican ， et al . High-efficiency dynamic three-dimensional shape measurement based on misaligned Gray-code light ［J］. Optics and Lasers in Engineering ， 2022 ， 150 ： 106873 .

WANG Jianhua ， YANG Yanxi . A new method for high dynamic range 3D measurement combining adaptive fringe projection and original-inverse fringe projection ［J］. Optics and Lasers in Engineering ， 2023 ， 163 ： 107490 .

ZHANG Pan ， ZHONG Kai ， LI Zhongwei ， et al . Hybrid-quality-guided phase fusion model for high dynamic range 3D surface measurement by structured light technology ［J］. Optics Express ， 2022 ， 30 （ 9 ）： 14600 - 14614 .

SONG Zhan ， JIANG Hualie ， LIN Haibo ， et al . A high dynamic range structured light means for the 3D measurement of specular surface ［J］. Optics and Lasers in Engineering ， 2017 ， 95 ： 8 - 16 .

CHEN Chao ， GAO Nan ， WANG Xiangjun ， et al . Adaptive projection intensity adjustment for avoiding saturation in three-dimensional shape measurement ［J］. Optics Communications ， 2018 ， 410 ： 694 - 702 .

BUDIANTO ， LUN D P K . Inpainting for fringe projection profilometry based on geometrically guided iterative regularization ［J］. IEEE Transactions on Image Processing ， 2015 ， 24 （ 12 ）： 5531 - 5541 .

HAN Hexiang ， GAO Nan ， ZHANG Guofeng ， et al . Three-dimensional morphology measurement of highly reflective objects based on three channel parallel processing ［J］. Acta Photonica Sinica ， 2024 ， 53 （ 7 ）： 0712003 .

韩鹤翔，高楠，张国锋，等 . 基于三通道并行的高反光物体三维形貌测量［J］. 光子学报， 2024 ， 53 （ 7 ）： 0712003 .

RIVIERE J ， RESHETOUSKI I ， FILIPI L ， et al . Polarization imaging reflectometry in the wild ［J］. ACM Transactions on Graphics ， 2017 ， 36 （ 6 ）： 1 - 14 .

SALAHIEH B ， CHEN Z ， RODRIGUEZ J J ， et al . Multi-polarization fringe projection imaging for high dynamic range objects ［J］. Optics Express ， 2014 ， 22 （ 8 ）： 10064 - 10071 .

FENG Shijie ， CHEN Qian ， ZUO Chao ， et al . Fast three dimensional measurements for dynamic scenes with shiny surfaces ［J］. Optics Communications ， 2017 ， 382 ： 18 - 27 .

BENVENISTE R ， UNSALAN C . A color invariant for line stripe-based range scanners ［J］. Computer Journal ， 2011 ， 54 （ 5 ）： 738 - 753 .

WANG Hao ， LU Ziyu ， HUANG Ziyang ， et al . A high-accuracy and reliable end-to-end phase calculation network and its demonstration in high dynamic range 3D reconstruction ［J］. Nanomanufacturing and Metrology ， 2025 ， 8 ： 5 .

DANG Guoqing ， ZHU Zhenmin ， CHENG Xiaoyan ， et al . Deep-learning-assisted composite polarized fringe projection profilometry for three-dimensional measurement of high-dynamic-range objects ［J］. Applied Optics ， 2025 ， 64 （ 1 ）： 221 - 232 .

SHEN Mengmeng ， HE Liangbo ， ZHANG Haihua ， et al . Deep learning based measurement accuracy improvement of high dynamic range objects in fringe projection profilometry ［J］. Optics Express ， 2024 ， 32 （ 20 ）： 35689 - 35702 .

XI Dejun ， HOU Lei ， WU Fei ， et al . Deep learning-based inpainting of high dynamic range fringe pattern for high-speed 3D measurement of industrial metal parts ［J］. Advanced Engineering Informatics ， 2024 ， 60 ： 102428 .

LI Mojing ， SUN Changku . A multi-task learning method for 3D reconstruction of highly reflective surfaces ［J］. Acta Photonica Sinica ， 2024 ， 53 （ 10 ）： 1012001 .

李默晶，孙长库 . 用于高反光表面三维重建的多任务学习方法［J］. 光子学报， 2024 ， 53 （ 10 ）： 1012001 .

ZHANG Zonghua ， TOWERS CE ， TOWERS DP . Time efficient color fringe projection system for 3D shape and color using optimum 3-frequency ［J］. Optics Express ， 2006 ， 14 （ 14 ）： 6444 - 6455 .

ZHANG Zonghua ， HUANG Shujun ， MENG Shasha ， et al . A simple， flexible and automatic 3D calibration method for a phase calculation-based fringe projection imaging system ［J］. Optics Express ， 2013 ， 21 （ 10 ）： 12218 - 12227 .

LI Wenguo ， LIU Tao ， TAI Manli ， et al . Three-dimensional measurement for specular reflection surface based on deep learning and phase measuring profilometry ［J］. Optik ， 2022 ， 271 ： 169983 .

WANG Hao ， ZHANG Chaobo ， QIAN Xiang ， et al . HDRSL Net for accurate high dynamic range imaging-based structured light 3D reconstruction ［J］. IEEE Transactions on Image Processing ， 2025 ， 34 ： 5486 - 5499 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Three-dimensional Reconstruction Method Integrating Active and Passive Polarization Based on Structured Light

Phase Unwrapping Algorithm Based on Gradient Consistency

Polarization-fused Binocular Stereo Vision Enhancement Method

3D Reconstruction Method for Continuous Scanning Structured Illumination Microscopy Based on Axial Gradient Selection

Deep Learning-based Point Cloud Registration via Neighborhood Geometric Centroids （Invited）

Related Author

LIU Weiguo

SUN Xueping

CHENG Jin

ZHENG Xinyan

LIU Huachen

LI Pangyue

ZHOU Shun

LI Yifeng

Related Institution

School of Optoelectronic Engineering， Xi'an Technological University

Xi'an Institute of Optics and Precision Mechanics， Chinese Academy of Sciences

School of Mechatronic Engineering， Xi'an Technological University

Xi'an Institute of Optics and Precision Mechanics， CAS

School of Optoelectronic Engineering， Xidian University

AI问答

Postal code：100079
Tel：（010）53879206 Email：tmw@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09082226号-64 京公网安备11010602201714号
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰