运动分割和光流估计的卫星视频超分辨率重建Super resolution reconstruction based on motion segmentation and optical flow estimation
卜丽静,郑新杰,张正鹏,肖一鸣
摘要(Abstract)：
针对卫星视频中存在局部运动目标的问题,该文提出了一种运动分割和光流估计联合约束的卫星视频超分辨率重建算法。首先通过视频帧间运动分割方法提取局部运动目标,获得其边缘信息;其次用光流方法对视频图像进行逐像素的运动估计,获得初始运动矢量场;利用分割边缘和运动矢量场进行联合约束,并统一运动目标内的光流矢量,获得纠正后的运动矢量场,并作为几何运动矩阵,将其补偿到超分辨率重建模型中生成高分辨率图像;最后用卫星视频数据进行实验,并与传统方法结果进行对比,证明该文算法可以有效地克服运动目标的伪影效应,提升了卫星视频的分辨率。
关键词(KeyWords)： 卫星视频;超分辨率重建;运动估计;运动分割
基金项目(Foundation): 国家自然科学基金项目(41501504,41301367)
作者(Author): 卜丽静,郑新杰,张正鹏,肖一鸣
DOI: 10.16251/j.cnki.1009-2307.2016.12.046
参考文献(References)：
- [1]岳林蔚,沈焕锋,袁强强,等.基于双边结构张量的局部自适应图像超分辨率重建[J].武汉大学学报:信息科学版,2015,40(4):493-497.
- [2]IRANI M,PELEG S.Improving resolution by image registration[J].Cvgip Graphical Models&Image Processing,1991,53(3):231-239.
- [3]PHAM T Q,VLIET L J V,SCHUTTE K.Robust fusion of irregularly sampled data using adaptive normalized convolution[J].Eurasip Journal on Advances in Signal Processing,2006(1):236-236.
- [4]HE Y,YAP K H,CHEN L,et al.A nonlinear least square technique for simultaneous image registration and super-resolution[J].IEEE Transactions on Image Processing,2007,16(11):2830-2841.
- [5]VRIGKAS M,NIKOU C,KONDI L P.Accurate image registration for MAP image super-resolution[J].Signal Processing:Image Communication,2013,28(5):494-508.
- [6]LU J,ZHANG H,SUN Y.Video super resolution based on non-local regularization and reliable motion estimation[J].Signal Processing:Image Communication,2014,29(4):514-529.
- [7]SHAH N R,ZAKHOR A.Resolution enhancement of color video sequences[J].IEEE Transactions on Image Processing,1999,8(6):879-885.
- [8]MITZEL D,POCK T,SCHOENEMANN T.Pattern recognition[M].Jena,Germany:Spring Berlin Heidelberg,2009.
- [9]卢涛,章瑾,陈白帆,等.多尺度自适应配准的视频超分辨率算法[J].武汉工程大学学报,2016,38(2):178-184.
- [10]ZHANG H,YANG J,ZHANG Y,et al.Image and video restorations via nonlocal kernel regression[J].IEEE Transactions on Cybernetics,2013,43(3):1035-1046.
- [11]杨勇,黄波,王桥,等.一种基于内容表示的图像序列运动分割算法[J].通信学报,2001,22(6):102-106.
- [12]TEKALP A M.Digital video processing[M]:Englewood Clliffs,NJ:Prentice-Hall,1995.
- [13]FAKTOR A,IRANI M.Video segmentation by nonlocal consensus voting[C]//Proc BMVC.[S.l.]:[s.n.],2014.
- [14]LIU C.Beyond pixels:exploring new representations and applications for motion analysis[D].Cambrige,MA,USA:Massachusetts Institute of Technology,2009.
- [15]陆文端.微分方程中的变分方法[M].北京:科学出版社,2003.