The urban agglomeration around Poyang Lake is considered a vital economic and ecological region in Jiangxi Province, and its land use/land cover change is believed to impact both local economic and social development, as well as the ecological environment. Exploring this land use/land cover change and its driving factors are regarded as significant for land management and sustainable development. Based on the Landsat remote sensing image data of five periods in 2003, 2009, 2013, 2018, and 2022 of the urban agglomeration around Poyang Lake, the land use of remote sensing images was firstly classified, and then the spatial-temporal characteristics of land use change in this region were studied using the methods of land use dynamics, land use transfer matrix, and land use comprehensive degree index. Finally, the driving factors of land use change in the study area were investigated using the geographical detector. The results reveal that the study area is primarily cultivated land and forest land, the area of construction land increases steadily, while other land types change irregularly, but the overall land type area decreases. The increase and decrease of cultivated land and forest land area are the main types of land change in the study area, and the conversion between different classes is frequent. The land use intensity in the middle of the study area is higher than that in other areas, while the land use intensity in the northeast is lower. Factor detection shows that the explanation degree of natural factors has a higher impact on land use change, and the explanation degree of social and economic factors has a higher impact on land use in the later stages. The results of interaction detection show that a significant interaction exists between the factors, and the interpretation of the two-factor interaction is higher than that of the single factor. It can be seen that land use change is affected by many factors.