A task loss optimization and load balancing scheduling algorithm under a queuing model was proposed to address the problems of inefficient task scheduling and load imbalance in cloud computing environments. A multi-server environment was abstracted into multiple infinite-capacity GI/M/1/∞ queue models, where task inter-arrival times follow a general distribution and service times adhere to an exponential distribution. By constructing an infinite-state Quasi-Birth-and-Death (QBD) process and applying a two-dimensional Markov process with a matrix geometric solution, steady-state probabilities were derived and performance metrics were quantified. Secondly, a multi-strategy integrated load balancing algorithm was designed: the concept of virtual waiting time was proposed, based on which the loss rate of the quantified task waiting tolerance threshold was calculated to improve the accuracy of task allocation. Combined with the idle queue (join-idle-queue, JIQ) strategy, tasks were prioritized to be assigned to idle servers to reduce waiting time. Through the heartbeat mechanism, the server status was sensed in real time, and parameters were dynamically adjusted to improve resource utilization. Finally, numerical experiments were conducted to compare the performance of the proposed algorithm with that of traditional methods in terms of task loss rate, waiting time, and system stability. The results show that the proposed algorithm significantly improves resource allocation efficiency, reduces the task loss rate, and enhances system stability, providing both theoretical and practical support for load balancing scheduling in high-traffic network environments.
YANG Xi-juan, ZHANG Ya-qing, WANG Bo, CAO Cun-yu, LI Xue-jun.
Task Loss Optimization and Load Balancing under Queueing Model[J].
Science Technology and Engineering, 2026, 26(25): 10967-10981 DOI:10.12404/j.issn.1671-1815.2506197
China Academy of Information and Communications Technology (CAICT). Cloud Computing Blue Book (2025)[R/OL]. (2025-07-22) [2025-08-26]. Beijing: China Academy of Information and Communications Technology. https://www.caict.ac.cn/kxyj/qwfb/bps/index_1.htm.
Ministry of Industry and Information Technology of the People’s Republic of China, Standardization Administration of the People’s Republic of China (SAC). Notice of the two ministries and commissions on issuing the “Guidelines for the Construction of a Comprehensive Standardization System for Cloud Computing (2025 Edition)”: MIIT Joint Sci. 〔2025〕No. 175[Z/OL]. Beijing: Ministry of Industry and Information Technology, 2025. (2025-10-09) [2025-12-12]. https://www.miit.gov.cn/zwgk/zcwj/wjfb/tz/art/2025/art_60eeb6e673e1423ea27ac6dd81830013.html.
Central Committee of the Communist Party of China (CCCPC). Proposal of the Central Committee of the Communist Party of China on Formulating the 15th Five-Year Plan for National Economic and Social Development[Z/OL]. Beijing: Central Committee of the Communist Party of China, 2025. (2025-10-28) [2025-12-12]. https://www.gov.cn/zhengce/202510/content_7046052.htm.
[9]
ChippagiriS, RavulaP, GangwaniD. Optimizing load balancing and task scheduling in cloud computing based on nature-inspired optimization algorithms[J]. European Journal of Theoretical and Applied Sciences, 2024, 2 (6): 794-805.
[10]
ElsakaanN, KamalA. A novel multi-level hybrid load balancing and tasks scheduling algorithm for cloud computing environment[J]. The Journal of Supercomputing, 2024, 80: 1-41.
LiMenghan, ZhengXiaoying, LiMingqi, et al. Research on online cloud storage traffic scheduling based on load balancing[J]. Science Technology and Engineering, 2015, 15(26): 70-75.
XuXiaoyuan, LiHaibo, HuangLi. Convex optimization analysis of joint delay tail probability for multi-heterogeneous files in cloud storage[J]. Computer Engineering and Applications, 2021, 57(5): 88-94.
[15]
PatelM G, BhoiU. A systematic review of different task scheduling algorithms in cloud computing[J]. International Journal of Modern Trends in Engineering and Research, 2015, 2(3): 382-388.
ChenHuangke, ZhuJianghan, ZhuXiaomin, et al. Resource delay-aware real-time task scheduling method in cloud computing[J]. Journal of Computer Research and Development, 2017, 54(2): 446-456.
YanHan, LiXia, CuiHongjun, et al. Calculation of reasonable land use scale for refueling area in service area based on queuing theory[J]. Science Technology and Engineering, 2017, 17(28): 150-153.
[20]
DollA, AbbasiM, ZhaoM, et al. Oversaturated intersections: a real-world assessment of polynomial fluid queue models[J]. Physica A: Statistical Mechanics and Its Applications, 2024, 651: 129864.
[21]
BogachevM I, PykoN S, TymchenkoN, et al. Approximate waiting times for queuing systems with variable cross-correlated arrival rates[J]. Physica A: Statistical Mechanics and its Applications, 2024, 654: 130152.
ZhangQiuping, SunSheng, LiuMin, et al. Online joint optimization mechanism of task offloading and service caching for multi-edge device collaboration[J]. Journal of Computer Research and Development, 2021, 58(6): 1318-1339.
[24]
LimaD H S, AquinoA L L, RossoO A, et al. Characterization of task allocation techniques in data centers based on information theory[J]. Physica A: Statistical Mechanics and Its Applications, 2024, 634: 129447.
[25]
SavitaM, TiwariR, SainiM L. Applications of queuing theory in cloud computing: a review[J]. SSRN Electronic Journal, 2024. DOI:10.2139/ssrn.4485292.
YangXijuan, LiZhongxue, LiSuoping, et al. Performance analysis of M/M/1/N queuing system with start-up time and working breakdown[J]. Control Theory & Applications, 2019, 36(4): 561-569.
[28]
MatsakI, KrasnitskiyS. Asymptotic behavior of the extreme values of queue length and waiting time in M/G/1 and GI/M/1 Systems[J]. Cybernetics and Systems Analysis, 2025, 61(1): 106-115.
[29]
MageedI A, BecheroulA. The fine thread between stability and randomness of the non-stationary D/M/1 Queue’s GI/M/1 pointwise of stationary fluid flow approximation model with application ultra-low latency of autonomous driving service[EB/OL]. (2024-05) [2025-08-26]. https://doi.org/10.20944/preprints202405.0649.v2.
HeDaode, XuJi, HuangZhengpeng. Hierarchical routing protocol for wireless sensor networks based on cluster head load balancing[J]. Science Technology and Engineering, 2020, 20 (22): 9122-9127.
[32]
ShenY, YangH, XieY, et al. Adaptive robustness optimization against network cascading congestion induced by fluctuant load via a bilateral-adaptive strategy[J]. Physica A: Statistical Mechanics and its Applications, 2023, 630: 129229.
XuJing, WangZhan, YuanGuojun, et al. Survey on fine-grained traffic control technology for intelligent computing centers[J]. Journal of Computer Research and Development, 2025, 62(11): 2806-2825.
[35]
MilaniA S, NavimipourN J. Load balancing mechanisms and techniques in the cloud environments: systematic literature review and future trends[J]. Journal of Network and Computer Applications, 2016, 71: 86-98.
[36]
SinghP. Queuing theory in cloud computing: analyzing M/M/1 and M/M/c/N models with AWS[J]. International Journal of Science and Social Science Research, 2025, 2(4): 122-134.
WangYuwei, LiuMin, MaCheng, et al. High-performance load balancing mechanism for network function virtualization[J]. Journal of Computer Research and Development, 2018, 55(4): 689-703.
ChengLingang, WangYaguang. Cloud computing resource scheduling method based on gray wolf optimization algorithm with distribution feature learning[J]. Computer Applications and Software, 2025, 42(5): 306-316.
LiuChunhong, LiWeili, JiaoJie, et al. An interpretable task termination state prediction method for cloud platforms[J]. Journal of Computer Research and Development, 2024, 61(3): 716-727.
ChenJili, LiHaijun, XieXiaolan. Short-term cloud resource prediction model based on temporal convolution and long short-term memory network[J]. Science Technology and Engineering, 2025, 25(7): 2856-2864.
[53]
TaoS, LiQ, ZhouQ, et al. Optimization research of heterogeneous 2D-parallel lattice boltzmann method based on deep computing unit[J]. Applied Sciences, 2024, 14(14): 6078.
[54]
吕光宏, 王坤. 时空图注意力机制下的 SDN 网络动态流量预测[J]. 计算机工程与应用, 2025, 61(8): 267-273.
[55]
LüGuanghong, WangKun. Dynamic traffic prediction of SDN network under spatio-temporal graph attention mechanism[J]. Computer Engineering and Applications, 2025, 61(8): 267-273.
[56]
HaightF A. Queueing with reneging[J]. Metrika, 1957, 1: 186-197.
[57]
DeviN, DalalS, SolankiK, et al. A systematic literature review for load balancing and task scheduling techniques in cloud computing[J]. Artificial Intelligence Review, 2024, 57(10): 276.
[58]
ChaudharyH, SharmaG, NishadD, et al. Advanced queueing and scheduling techniques in cloud computing using AI-based model order reduction[J]. Discover Computing, 2025, 28(1): 9581.
[59]
NiranjanS P, Devi LathaS, VlaseS, et al. Analysis of bulk queueing model with load balancing and vacation[J]. Axioms, 2024, 14: 18.
[60]
MedhiJ. Stochastic models in queueing theory[M]. Boston: Birkhäuser, 2003.
[61]
NeutsM F. Matrix-geometric solutions in stochastic models: an algorithmic approach[M]. Baltimore: Johns Hopkins University Press, 1981.
[62]
LatoucheG, RamaswamiV. Introduction to matrix analytic methods in stochastic modeling[M]. Philadelphia: SIAM, 1999.
ZhangWenli, WanXiaojuan, YangJingya. Application of matrix eigenvalues and eigenvectors in solving differential equations[J]. Journal of Changzhi University, 2024, 41(5): 7-15.
[65]
GrayR M. Probability, random processes, and ergodic properties[M]. New York: Springer, 2009.
[66]
LittleJ D C. A proof for the queuing formula: L=λw[J]. Operations Research, 1961, 9(3): 383-387.