In order to explore the strain differences under loading among asphalt mixtures with different structures, the horizontal strains of asphalt mixtures in indirect tensile mode were visualized based on the digital image correlation method. Quantitative indicators such as average strain, relative strain intensity, influence strain, high cracking strain, and strain probability distribution were proposed to analyze the strain differences and establish the relationship between structure and strain. The results indicate that strain and stress are closely related, and the average peak strain can reflect the bearing capacity. Viscoelasticity can effectively enhance the bearing time of the specimen and generate greater strain. The suspended structure promotes collaborative deformation, the boundary of the strain zone is regular, the skeleton structure leads to irregular strain distribution, defects can cause high strain, and the crack propagation path is complex. AC13 has low strain uniformity, SMA13 has high strain non-uniformity, OGFC13 has high strain uniformity. The influence of stress mode is higher than that of structural differences. The stress mode determines the trend of change, and the structural characteristics affect the rate of evolution. The research results provide critical analytical methods and evaluation criteria for stress transfer and failure cracking of asphalt mixtures in viscoelastic states, which contributes to the structural design of asphalt mixtures and enhances the durability of asphalt pavements.