Neighborhood-Constrained Video Stabilization and Frame-Centering Compensation for UAV Target Tracking
DOI:
https://doi.org/10.70088/e1zhqb44Keywords:
UAV tracking, video stabilization, neighborhood constraint, frame centering, camera-motion compensationAbstract
Camera jitter and target drift degrade visual tracking by unmanned aerial vehicles (UAVs), especially near frame boundaries. This study proposes a modular post-processing method that combines neighborhood-constrained video stabilization with frame-centering compensation. Adjacent-frame phase correlation estimates global translation. A local median and Gaussian temporal weights, combined with residual down-weighting, construct a robust camera path that suppresses isolated motion-estimation errors. A bounded centering term then moves the target toward a safety region while preserving frame content. The method requires no inertial sensor and can operate after correlation-filter, Siamese, or Transformer trackers. A pilot was conducted on an 898-frame UAV123 subset. Target-center RMS error decreased from 164.58 to 82.58 pixels (49.82%), safety-region coverage increased from 65.26% to 100%, and frame retention remained 90.36%. Under injected noise levels of 2, 4, and 8 pixels, trajectory-recovery error decreased by 57.95%, 68.70%, and 74.26%, respectively. These results indicate geometric feasibility, while full UAV123, UAV20L, and DTB70 benchmarks remain necessary before general performance claims.References
B. Ye, H. Chang, B. Ma, S. Shan, and X. Chen, "Joint feature learning and relation modeling for tracking: a one-stream framework," in European Conference on Computer Vision (ECCV), 2022.
Y. Zheng, B. Zhong, Q. Liang, Z. Mo, S. Zhang, and X. Li, "ODTrack: online dense temporal token learning for visual tracking," in Proc. AAAI Conf. Artif. Intell., vol. 38, no. 7, pp. 7588–7596, 2024.
Y. Wu, Y. Li, M. Liu, X. Wang, X. Yang, H. Ye, et al., "Learning an adaptive and view-invariant vision transformer for real-time UAV tracking," IEEE Trans. Circuits Syst. Video Technol., 2025.
J. Liu, H. Wang, C. Ma, Y. Su, and X. Yang, "SiamDMU: Siamese dual mask update network for visual object tracking," IEEE Trans. Emerg. Topics Comput. Intell., 2024.
M. Grundmann, V. Kwatra, and I. Essa, "Auto-directed video stabilization with robust L1 optimal camera paths," in IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2011.
S. Jeon, I. Yoon, J. Jang, S. Yang, J. Kim, and J. Paik, "Robust video stabilization using particle keypoint update and l1-optimized camera path," Sensors, vol. 17, no. 2, p. 337, 2017.
Y. G. Lee, "A novel camera path planning algorithm for real-time video stabilization," EURASIP J. Image Video Process., 2019.
M. R. Souza and H. Pedrini, "Digital video stabilization: algorithms and evaluation," in SIBGRAPI Conf. Graphics, Patterns Images, 2019.
M. R. Souza, H. A. Maia, and H. Pedrini, "Rethinking two-dimensional camera motion estimation assessment for digital video stabilization: a camera motion field-based metric," Neurocomputing, p. 126768, 2023.
Q. Huang, J. Liu, C. Jiang, and Y. Wang, "DMCVS: decomposed motion compensation-based video stabilization," IET Image Process., 2024.
L. Yang, Z. Liu, G. Wang, and X. Wang, "Image-based visual servo control for ground target tracking using a fixed-wing UAV with pan-tilt camera," in Int. Conf. Unmanned Aircraft Syst. (ICUAS), 2020.
L. W. Krakow, C. M. Eaton, and E. K. P. Chong, "Simultaneous non-myopic optimization of UAV guidance and camera gimbal control for target tracking," in IEEE Conf. Control Technol. Appl. (CCTA), 2018.
P. Nousi, I. Mademlis, I. Karakostas, A. Tefas, and I. Pitas, "Embedded UAV real-time visual object detection and tracking," in IEEE Int. Conf. Real-time Comput. Robot. (RCAR), 2019.
T. Keawboontan and M. Thammawichai, "Toward real-time UAV multi-target tracking using joint detection and tracking," IEEE Access, 2023.
Z. Liang, J. Wang, G. Xiao, and L. Zeng, "FAANet: feature-aligned attention network for real-time multiple object tracking in UAV videos," Chin. Opt. Lett., vol. 20, p. 081101, 2022.
M. Zhu, H. Zhang, J. Zhang, and L. Zhuo, "Multi-level prediction Siamese network for real-time UAV visual tracking," Image Vis. Comput., p. 104002, 2020.
Y. Lu and L. Sun, "UAV target tracking algorithm based on kernel correlation filter," in Chinese Control Decis. Conf., 2023.
P. Zhang, J. Zhao, D. Wang, H. Lu, and X. Ruan, "Visible-thermal UAV tracking: a large-scale benchmark and new baseline," in IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2022.
H. Yu, K. Su, and L. Wang, "A lightweight UAV target tracking method against occlusion and viewpoint changes," Automation Appl., 2026.
D. Yu, H. Wang, S. Liu, J. Li, S. Gao, and Y. Feng, "Research on lightweight monocular UAV target tracking based on KCF," Commun. Inf. Technol., 2026.
M. Zhao, B. Zheng, H. Sun, M. Ma, C. Song, and J. Bai, "UAV aerial target tracking combining attention and anti-occlusion strategies," Chin. J. Liquid Crystals Displays, 2026.
M. Mueller, N. Smith, and B. Ghanem, "A benchmark and simulator for UAV tracking," in Computer Vision – ECCV 2016, Cham: Springer, 2016, pp. 445–461.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Huihui Yang, Yongkang Xia (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
