用于多光谱行人检测的改进光照权重融合方法

金彦亮; 葛飞扬

Chinese

您当前的位置：

首页 >

文章列表页 >

用于多光谱行人检测的改进光照权重融合方法

更新时间：2026-09-04

- 用于多光谱行人检测的改进光照权重融合方法
- Improved fusion method based on ambient illumination condition for multispectral pedestrian detection
- 微电子学与计算机 2021年38卷第1期页码：27-32
- 作者机构：
  
  上海大学通信与信息工程学院,上海,200072
- 作者简介：
- 基金信息：
  
  上海市科委重点项目 19511102803
- DOI：
  中图分类号：
- 纸质出版：2021
- 稿件说明：
移动端阅览
金彦亮, 葛飞扬. 用于多光谱行人检测的改进光照权重融合方法[J]. 微电子学与计算机, 2021, 38(1): 27-32.

JIN Yan-liang, GE Fei-yang. Improved fusion method based on ambient illumination condition for multispectral pedestrian detection[J]. 2021, 38(1): 27-32.
金彦亮, 葛飞扬. 用于多光谱行人检测的改进光照权重融合方法[J]. 微电子学与计算机, 2021, 38(1): 27-32. DOI：

JIN Yan-liang, GE Fei-yang. Improved fusion method based on ambient illumination condition for multispectral pedestrian detection[J]. 2021, 38(1): 27-32. DOI：

摘要

着卷积神经网络的发展

基于多光谱图像的行人检测研究取得了巨大进步

且应用广泛.最近研究表明

融合由多光谱相机(可见光和热成像相机)捕获的图像信息可以使行人在强光和弱光条件下的检测都变得鲁棒.然而

如何根据光照条件有效地融合图像信息仍缺乏进一步的研究.本文提出了一种多层次特征提取方法

旨在从不同特征层提取有用信息.同时

还提出一种置信度融合机制

测量多光谱图像的光照情况.采用一个融合函数对双流网络输出的分类结果和RPN输出的分类结果进行融合

提高行人检测的性能.通过实验将所提出的多光谱光照感知检测R-CNN(MIAD-RCNN)与现有的多光谱行人检测器进行比较

该方法在全天候均具有较低的漏检率和较快的速度.

Abstract

With the development of convolutional neural network

the research of pedestrian detection based on multi-spectral images has made great progress and has been widely used. Recent studies have shown that the fusion of image information captured by multispectral sensors (visible and thermal imaging cameras) makes pedestrian detection robust in both good and poor lighting conditions. However

there is still a lack of further research on how to effectively fuse image information according to lighting conditions. This paper presents a novel multi-feature extraction method aiming at extracting useful information from different feature levels. Further

this paper also proposes a novel classification score fusion mechanism. By measuring the illumination in-formation of the input multispectral images and using a fusion function

the classification results output from the two-stream classification network and RPN are combined to improve the performance of pedestrian de-tection. In conclusion

compared with the latest multispectral pedestrian detectors through experiments

the proposed multispectral illumination-aware detection R-CNN (MIAD-RCNN) achieves a lower miss rate and a faster speed during both day time and night time.

关键词

Keywords

references

GUAN D Y, CAO Y P, YANG J X, et al. Fusion of multispectral data through illumination-aware deep neural networks for pedestrian detection[J]. Information Fusion, 2019, 50: 148-157. DOI: 10.1016/j.inffus.2018.11.017.

HWANG S, PARK J, KIM N, et al. Multispectral pedestrian detection: benchmark dataset and baseline[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015: 1037-1045. DOI: 10.1109/CVPR.2015.7298706.

BRAZIL G, YIN X, LIU X M. Illuminating pedestrians via simultaneous detection and segmentation[C]//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice: IEEE, 2017: 4950-4959. DOI: 10.1109/ICCV.2017.530.

WAGNER J, FISCHER V, HERMAN M, et al. Multispectral pedestrian detection using deep fusion convolutional neural networks[C]//24th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges: ESANN, 2016.

ZHANG L L, LIN L, LIANG X D, et al. Is faster R-CNN doing well for pedestrian detection?[C]//14th European Conference on Computer Vision. Amsterdam: Springer, 2016: 443-457. DOI: 10.1007/978-3-319-46475-6_28.

KONIG D, ADAM M, JARVERS C, et al. Fully convolutional region proposal networks for multispectral person detection[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Honolulu: IEEE, 2017: 49-56. DOI: 10.1109/CVPRW.2017.36.

LIU J J, ZHANG S T, WANG S, et al. Multispectral deep neural networks for pedestrian detection[M]//WILSON R C, HANCOCK E R, SMITH W A P. Proceedings of the British Machine Vision Conference. British: BMVA Press, 2016. DOI: 10.5244/C.30.73.

REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[C]//Proceedings of the 28th International Conference on Neural Information Processing Systems. Cambridge: ACM, 2015: 91-99.

GUAN D Y, CAO Y P, YANG J X, et al. Exploiting fusion architectures for multispectral pedestrian detection and segmentation[J]. Applied Optics, 2018, 57(18): D108-D116. DOI: D108

浏览量

184

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于多尺度融合与小目标增强的航拍车辆检测算法

V型沟槽SiC中子探测器的蒙特卡洛分析

低功耗设计的双链电源关断策略的实现与验证

大模型发展综述：从BERT到Deepseek的技术演进

基于监控指标关联性的微服务异常检测