To investigate the influence of coarse aggregate morphological characteristics and particle content on the compacting behavior of asphalt mixture, smart rock was used to test the rutting test, obtain the particle mechanics and motion response data, construct coarse aggregate profiles with different morphological characteristics by 3D laser scanning equipment and image processing technology, and build digital specimens of asphalt mixture rutting by using discrete element method. Virtual rutting tests were carried out on the digital specimens, and the model prediction accuracy was verified with the help of smart particle test results. The high-precision model was used to study the influence of coarse aggregate shape and content on the compacting behavior of the mixture, and the internal stress and particle displacement of the digital specimens were used to evaluate the deformation resistance of the mixture, and the skeleton contact characteristics were analyzed with the average number of contact points of a single aggregate and the force chain size as quantitative indicators. The results show these as follows. Smart particle test results can effectively verify the accuracy of the prediction model, and the maximum difference between the measured and predicted acceleration amplitude is 0.021 5g. In the virtual test of rutting, the internal stresses of the specimens formed by cubic-shaped aggregates are higher than those of the mixes containing other shapes of aggregates, and they have smaller migration degrees of freedom, and the vertical and horizontal displacements of the particles are only 3.65 mm and 1.89 mm at 40% of the aggregates. The aggregate content affects the compacting behavior of asphalt mixes, and the rutting resistance and skeleton contact characteristics of asphalt mixes increase with the increase of cubic aggregate content, while the performance decays significantly when the content of needle-shaped, flaky or pin-like aggregate particles is greater than 20%.