Aiming at the problem that ViBe (visual background extractor) algorithm is prone to ghosting during moving target detection, an improved algorithm, ViBe-BR (ViBe with background restoration) was proposed by adding a background restoration stage to the original algorithm. First, the foreground region within the background image was pre-extracted by combining three-frame differencing. Then, the interior of the region was filled using the background pixels around the foreground region to obtain the restored image; Finally, the restored image was corrected and ViBe detection was performed based on the reduced background to achieve the effect of suppressing ghosting. The experimental results show that the ViBe-BR algorithm achieves good detection results in four different scenes, and compared with the ViBe algorithm, the average precision, recall, and F₁ value of foreground detection have been improved by 0.222, 0.03, and 0.123 in that order, which effectively eliminates the influence of ghosting, and it can be applied to practical geo-localization tasks in order to obtain the geographic location information of the moving targets.