Visual Tracking with Long-Short Term Based Correlation Filter

Visual object tracking is a fundamental problem in computer vision, and has been greatly improved with the rapid development of deep learning. However, existing tracking methods with single model update strategy cannot guarantee the robustness of tracker in complex scenes. In this paper, we innovatively propose a novel real-time long-short-term multi-model based tracking method. For the fusion of long-term and short-term features contain more spatiotemporal information, three models with different update periods are designed to learn the long-term and short-term features to improve the tracking robustness. Besides, the hierarchical feature contain deep convolution features and handcraft features are used to represent the current object, which can further improve the tracking accuracy with richer semantic information. Finally, to solve the inaccurate prediction of object position due to the cosine window in the correlation filter, the bounding-box regression strategy is introduced to optimize the final object position. Extensive experiments on OTB, VOT, TC128, and UAV123 datasets demonstrate that the proposed method performs favorably against state-of-the-art algorithms while running at 24 fps.