CHEN Genlong, LIU Hao, ZHOU Jian, et al. Subrate-adaptive interframe patch matching for video compressive sensing reconstruction[J]. 2022, 54(5): 146-151.
DOI:
CHEN Genlong, LIU Hao, ZHOU Jian, et al. Subrate-adaptive interframe patch matching for video compressive sensing reconstruction[J]. 2022, 54(5): 146-151.DOI: 10.11918/202105063.
Subrate-adaptive interframe patch matching for video compressive sensing reconstruction
In contrast with the Shannon sampling which requires large-scale samples
the compressive sampling has unique advantages in energy-efficient representation of video signals. When the sampling subrates of a keyframe and a non-keyframe are inconsistent
the existing interframe patch matching algorithms show unstable recovery quality under different subrate combinations. In order to fully utilize the temporal correlation between frames
a subrate-adaptive interframe patch matching algorithm was proposed for video compressive sensing reconstruction
where the differential interframe matching mechanism was performed according to the relative change between keyframe sampling subrate and non-keyframe sampling subrate for better adaptation of video bitstream generated from different subrate combinations. Firstly
the measurements of each frame were reconstructed to obtain the corresponding intraframe results respectively. Then
the adaptive interframe reconstruction was implemented according to the growth ratio of the keyframe sampling subrate to the non-keyframe sampling subrate. In the case of low growth ratio
the current frame selected the nearest keyframe and the non-keyframe in the same direction as its co-directional double reference frames for patch matching reconstruction. In the case of high growth ratio
the current frame gradually selected the reconstruction results of multiple reference frames for multi-stage patch matching reconstruction. Compared with the existing reconstruction algorithms
the proposed algorithm could achieve more stable reconstruction performance during the typical framework of video compressive sensing
and thus the recovery quality of video sequence was consistently improved.