Brain fatigue in visual display terminal (VDT) operators causes a sharp decline in cognitive efficiency and threatens human-machine system safety, making fatigue detection critically significant. Existing physiological signal-based methods are limited by low effectiveness and high inter-subject feature distribution variability. To address these issues, feature selection and fusion were first performed. Classification performance was improved using ensemble learning, and inter-subject variability was reduced through feature transfer methods. A brain fatigue detection experiment based on multimodal physiological signals was conducted. Fatigue was induced by designing a continuous computational task combining mental arithmetic and 2-Back tests. Physiological data—including electrocardiogram (ECG), electroencephalogram (EEG), galvanic sskin response (GSR), respiration (RESP), and electromyography (EMG)—were collected from 11 volunteers. When only ensemble learning was applied, the fatigue detection model achieved 86.32% accuracy. After integrating feature transfer, the maximum mean discrepancy (MMD) between cross-subject features was reduced by 63.1%, and accuracy improved to 90.60%. The results confirm that the proposed method achieves higher recognition accuracy, providing a robust framework for brain fatigue detection in VDT operators using multimodal physiological signals.
WANG Kai-yuan, HE Mei-rong, PENG Zi-shuai, ZHANG Jun-ran.
Brain Fatigue Detection in Visual Display Terminal Operators Based on Ensemble Learning and Feature Transfer[J].
Science Technology and Engineering, 2026, 26(7): 2960-2967 DOI:10.12404/j.issn.1671-1815.2502024
JiangZiqi. Research on the mechanisms of physical workload and mental workload in VDT work[D]. Yangzhou: Yangzhou University, 2024.
[3]
JiaH Q, LinC J, WangE M. Effects of mental fatigue on risk preference and feedback processing in risk decision-making[J]. Scientific Reports, 2022, 12(1): 1-9.
WangLei, SunRuishan. Implementation of real-time monitoring method for the fatigue of air traffic controllers[J]. Safety and Environmental Engineering, 2013, 20(4): 87-91.
ZhangRong, LiangXinyue. Review of research on fatigue detection methods for aviation personnel[J]. Computer Engineering and Applications, 2024, 60(20): 84-95.
[8]
ImranM A A, NasirzadehF, KarmakarC. Designing a practical fatigue detection system: a review on recent developments and challenges[J]. Journal of Safety Research, 2024, 90: 100-114.
ZhangRui, ZhuTianjun, ZouZhiliang, et al. Review of research on driver fatigue driving detection methods[J]. Computer Engineering and Applications, 2022, 58(21): 53-66.
[11]
ChangY H, YangH H, HsuW J. Effects of work shifts on fatigue levels of air traffic controllers[J]. Journal of Air Transport Management, 2019, 76: 1-9.
[12]
TorbjörnA, MatsG. Subjective and objective sleepiness in the active individual[J]. International Journal of Neuroscience, 1990, 52(1/2): 29-37.
ShaoShuyu, WuJintao, ZhangPeng, et al. Mental fatigue of intelligent warehouse logistics picking operators in human-computer interaction[J]. Science Technology and Engineering, 2023, 23(19): 8279-8287.
[15]
GündoğduS, DoğanE A, et al. Assessment of mental fatigue and stress on electronic sport players with data fusion[J]. Medical & Biological Engineering & Computing, 2021, 59: 1691-1707.
YangRumin, LeiQian, YuChengbo. Pulse wave mental fatigue detection algorithm based on BA-RFC[J]. Science Technology and Engineering, 2022, 22(4): 1495-1501.
[18]
HuJ, MinJ. Automated detection of driver fatigue based on EEG signals using gradient boosting decision tree model[J]. Cognitive Neurodynamics, 2018, 12: 431-440.
[19]
Vargas-LopezO, Perez-RamirezC A, Valtierra-RodriguezM, et al. An explainable machine learning approach based on statistical indexes and SVM for stress detection in automobile drivers using electromyographic signals[J]. Sensors, 2021, 21(9): 3155.
[20]
LiD, ChenC. Research on exercise fatigue estimation method of Pilates rehabilitation based on ECG and sEMG feature fusion[J]. BMC Medical Informatics and Decision Making, 2022, 22(1): 67.
[21]
MinJ, CaiM, GouC, et al. Fusion of forehead EEG with machine vision for real-time fatigue detection in an automatic processing pipeline[J]. Neural Computing and Applications, 2023, 35: 8859-8872.
JiangRunqiang, ChenLanlan, ChenQin. Driving stress detection based on unsupervised feature learning of single module physiological signal[J]. Journal of East China University of Science and Technology, 2021, 47(4): 475-482.
[26]
LiY, LiK, WangS, et al. Pilot behavior recognition based on multi-modality fusion technology using physiological characteristics[J]. Biosensors, 2022, 12: 404.
[27]
MinJ, XiongC, ZhangY, et al. Driver fatigue detection based on prefrontal EEG using multi-entropy measures and hybrid model[J]. Biomedical Signal Processing and Control, 2021, 69: 102857.
ZhaoGuoliang, LiuQiang, ChenZeping, et al. Driving fatigue detection based on interpretable sparrow search algorithm optimized random forest algorithm[J]. Science Technology and Engineering, 2024, 24(30): 13161-13169.
QiuYihui. Cross-subject fatigue driving recognition model based on improved euclidean space alignment and multi-feature fusion transfer learning[D]. Nanchang: Nanchang University, 2023.
[36]
WangZ, WangY. Emotion recognition based on multimodal physiological electrical signals[J]. Frontiers in Neuroscience, 2025, 19: 1512799.
[37]
LiuY, LanZ, CuiJ, et al. Inter-subject transfer learning for EEG-based mental fatigue recognition[J]. Advanced Engineering Informatics, 2020, 46: 101157.
[38]
PanS J, TsangI W, KwokJ T, et al. Domain adaptation via transfer component analysis[J]. IEEE Transactions on Neural Networks, 2011, 22(2): 199-210.