Residual Reinforcement Learning for Autonomous Transluminal Intervention

Xiang-rong TANG , Gui-bin BIAN , Zhen LI , Rui-chen MA

Science Technology and Engineering ›› 2025, Vol. 25 ›› Issue (17) : 7244 -7251.

PDF
Science Technology and Engineering ›› 2025, Vol. 25 ›› Issue (17) : 7244-7251 DOI: 10.12404/j.issn.1671-1815.2404338
research-article
Residual Reinforcement Learning for Autonomous Transluminal Intervention
Author information +
History +
PDF

Abstract

The natural orifice intervention using continuum robots faces challenges such as tortuous and narrow intervention paths, as well as compressive forces exerted by soft tissues in the orifice. To address the issue in the delivery process where existing planning methods struggle to balance multiple control objectives, resulting in difficulty in reaching deeper positions, an autonomous planning scheme based on residual reinforcement learning was proposed. The method enables the autonomous delivery of continuum robots through natural orifices. A feedback deviation model between the delivery posture of the continuum robot and the spatial state of the natural orifice was established to control the posture target during the delivery process. Simultaneously, a Markov model of the overall motion process of the continuum robot was constructed to train the reinforcement learning algorithm. A residual strategy, generated by combining posture feedback control with reinforcement learning control, was used to output the optimal actions for the continuum robot's delivery process. Experiments conducted in a simulated bronchial orifice show that the proposed method converges over 60% faster than existing methods and can plan smooth, collision-free trajectories for the continuum robot's intervention through the orifice, outperforming existing methods in several key metrics.

Keywords

continuum robot / autonomous planning / residual strategy / transluminal intervention / reinforcement learning

Cite this article

Download citation ▾
Xiang-rong TANG, Gui-bin BIAN, Zhen LI, Rui-chen MA. Residual Reinforcement Learning for Autonomous Transluminal Intervention. Science Technology and Engineering, 2025, 25(17): 7244-7251 DOI:10.12404/j.issn.1671-1815.2404338

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (5575KB)

22

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉