Color steel buildings are concentrated on a large scale in key cities in the northwest, representing the process of urban evolution, to a certain extent, affecting urban development. Studying the spatiotemporal evolution process of urban color steel buildings provides a new perspective and data for analyzing urban landscape patterns, which helps to explore the micro-evolution process of urban landscape patterns. Taking Urumqi City as an example, this paper first comprehensively uses landscape indices and multi-order adjacency indices to analyze the changes in the landscape pattern of color steel buildings and the pattern of landscape expansion. Then, combined with the geographical detector model, it explores the factors that influenced the changes in the landscape pattern of color steel buildings in Urumqi City from 2005 to 2020. The results show that: (1) The expansion of color steel buildings in Urumqi City is mainly dominated by large-scale color steel buildings, which are heavily concentrated in industrial parks and areas with concentrated industrial land. Midong District and Toutun River District are the areas with the fastest expansion of color steel buildings. (2) The expansion of color steel buildings is mainly spreading, and the trend of expansion is weakening year by year. The overall distribution mode is gradually changing from discrete to compact distribution, and the efficiency of urban land use is continuously improving. (3) Transportation factors are essential for expanding color steel buildings. The interaction between factors is enhanced by two factors, among which the interaction between transportation conditions and other factors is the most significant.