
科学技术与工程

中国技术经济学会
Residual Reinforcement Learning for Autonomous Transluminal Intervention
Xiang-rong TANG , Gui-bin BIAN , Zhen LI , Rui-chen MA
Science Technology and Engineering ›› 2025, Vol. 25 ›› Issue (17) : 7244 -7251.
The natural orifice intervention using continuum robots faces challenges such as tortuous and narrow intervention paths, as well as compressive forces exerted by soft tissues in the orifice. To address the issue in the delivery process where existing planning methods struggle to balance multiple control objectives, resulting in difficulty in reaching deeper positions, an autonomous planning scheme based on residual reinforcement learning was proposed. The method enables the autonomous delivery of continuum robots through natural orifices. A feedback deviation model between the delivery posture of the continuum robot and the spatial state of the natural orifice was established to control the posture target during the delivery process. Simultaneously, a Markov model of the overall motion process of the continuum robot was constructed to train the reinforcement learning algorithm. A residual strategy, generated by combining posture feedback control with reinforcement learning control, was used to output the optimal actions for the continuum robot's delivery process. Experiments conducted in a simulated bronchial orifice show that the proposed method converges over 60% faster than existing methods and can plan smooth, collision-free trajectories for the continuum robot's intervention through the orifice, outperforming existing methods in several key metrics.
continuum robot / autonomous planning / residual strategy / transluminal intervention / reinforcement learning
/
| 〈 |
|
〉 |