Regularized Autoencoder Perturbation Feature Selection Algorithm

Chong MENG , Bin NIE , Lei JIANG , Ming LIU , Chen-hao SHI

Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (16) : 6918 -6931.

PDF
Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (16) : 6918-6931 DOI: 10.12404/j.issn.1671-1815.2507073
research-article
Regularized Autoencoder Perturbation Feature Selection Algorithm
Author information +
History +
PDF

Abstract

Boruta is a feature selection algorithm based on random forests, whose core principle involves introducing shadow features to evaluate the importance of original features, thereby obtaining a subset of features with higher importance than their shadow counterparts. However, Boruta’s shadow feature generation mechanism involves randomly shuffling the original features, exhibiting significant randomness and uncertainty. Consequently, focusing on the shadow feature generation mechanism, a regularised autoencoder perturbation feature selection algorithm (RAE-PFS) injected with Gaussian noise was proposed. The proposed algorithm learned structural information from original features via a regularised autoencoder, encoded the original features into the latent space latent space, introduced Gaussian noise to perturb the latent space, and decoded them to generate shadow features. After merging with original features, a feature subset with higher importance than shadow features was obtained using a random forest. Experiments across eight public datasets and five classifiers demonstrate that the proposed RAE-PFS reduces the feature selection rate by 8.34% compared to traditional Boruta, while significantly improving classification accuracy, precision, and recall. Finally, interpretability analysis based on SHAP was performed on medical datasets to verify the rationality of the features selected by RAE-PFS.

Graphical abstract

Keywords

feature selection / Boruta / regularised autoencoder (RAE) / shadow features

Cite this article

Download citation ▾
Chong MENG, Bin NIE, Lei JIANG, Ming LIU, Chen-hao SHI. Regularized Autoencoder Perturbation Feature Selection Algorithm. Science Technology and Engineering, 2026, 26(16): 6918-6931 DOI:10.12404/j.issn.1671-1815.2507073

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (9870KB)

26

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉