Aiming at the problem that the visual background extractor (ViBe) algorithm is prone to ghosting during moving target detection, an improved algorithm, ViBe-BR (ViBe with Background Restoration) is proposed by adding a background restoration stage to the original algorithm. First, the foreground region within the background image is pre-extracted by combining three-frame differencing; Then, the interior of the region is filled using the background pixels around the foreground region to obtain the restored image; Finally, the restored image is corrected and ViBe detection is performed based on the reduced background to achieve the effect of suppressing ghosting. The experimental results show that the ViBe-BR algorithm achieves good detection results in four different scenes, and compared with the ViBe algorithm, the average precision, recall, and F1 value of foreground detection have been improved by 0. 222, 0.03, and 0. 123 in that order, which effectively eliminates the influence of ghosting, and it can be applied to practical geo-localization tasks in order to obtain the geographic location information of the moving targets.