Currently, mainstream gait recognition methods often rely on stacked convolutional layers to gradually expand the receptive field and integrate local features. These methods mostly use shallow networks, which have limitations in extracting global features from gait images and lack attention to temporal cycle feature information. Therefore, a deep neural network algorithm combining Transformer and 3D convolution, named 3D convolutional gait recognition network based on AdaptFormer and Spect-Conv (3D-ASgaitNet) was proposed. Firstly, the initial residual convolution layer converts the binary contour data into a floating-point encoded feature map to provide dense low-level structural features. On this basis, the spectral layer enhances the feature extraction ability through the joint processing of frequency domain and time domain, and uses the pseudo-3D residual convolution module to further extract advanced spatio-temporal features. Finally, AdaptFormer module was integrated to provide flexible feature transformation capability through lightweight down-sampling and up-sampling network structure to adapt to different data distribution and task requirements. 3D-ASgaitNet was carried out on four publicly available indoor datasets (CASIA-B, OU-MVLP) and outdoor datasets (GREW, Gait3D), and achieved recognition accuracy rates of 99.84%, 87.83%, 45.32% and 72.12%, respectively. Experimental results show that the recognition accuracy of the proposed method in CASIA-B and Gait3D data sets is close to the performance of SOTA.