In order to explore the adhesion properties between rubber modified asphalt and aggregates, three typical aggregates, limestone, basalt and granite, and their representative oxide components, were selected. Dynamic shear rheological test and contact angle test were used to calculate the interaction parameters and surface energy parameters of rubber modified asphalt and aggregates, and their adhesion work and peeling work were calculated through molecular dynamics simulation. The accuracy and reliability of the test results were verified. The results show that the order of interfacial interaction between rubber modified asphalt and the three aggregates is limestone >basalt > granite. Silane coupling agent can significantly improve the hydrophobicity of granite aggregate, thus increasing its adhesion to rubber modified asphalt. The results of molecular dynamics simulation are basically consistent with those calculated based on surface energy. The results provide reference for the characterization of adhesion between aggregates and rubber modified asphalt.