To address the issues of long stitching time due to numerous mismatched feature points and insufficient stitching accuracy when using all feature points directly in image stitching tasks, an optimized image stitching method combining a matching point increasing strategy with Random Sample Consensus (RANSAC) is proposed in this paper. The method initially screened feature points to prevent numerous ineffective samples, thus improving computational efficiency. Then, a progressive sampling strategy was employed to incrementally increase matching points and repeatedly sample for precise results. Finally, the optimal model was obtained by utilizing a new loss function based on root mean square error to filter the results. The experimental results indicate that, without a noticeable increase in time consumption, the interior point rate of the algorithm in this paper is further enhanced, the mean and root mean square errors of feature points have decreased significantly, the accuracy of image stitching is improved, the misalignment phenomenon at the stitching seam is effectively improved, and the stitching errors in image stitching tasks are significantly reduced.