基于深度强化学习的水下采油树系统风险管控决策方法
DOI:
作者:
作者单位:

1.中海油能源发展股份有限公司安全环保分公司;2.中国石油大学华东 机电工程学院;3.中国石油大学(华东);4.中国海洋石油集团有限公司海南分公司

作者简介:

通讯作者:

中图分类号:

X937

基金项目:

国家重点研发计划(2022YFC2806100);海油发展重大专项(HFKJ-ZD-AH-2024-01-04);国家杰出青年科学基金项目(52325107)


Deep reinforcement learning-based risk control decision-making method for subsea tree systems
Author:
Affiliation:

1.CNOOC EnerTech;2.College of Mechanical and Electrical Engineering,China University of Petroleum;3.CNOOC EnerTech, Safety and Environmental Protection Branch;4.Hainan Branch of China National Offshore Oil Corporation

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着我国海洋油气开发的规模与速度不断扩大,海洋油气平台面对恶劣环境和自身缺陷暴露众多安全问题,如何依据海洋石油平台关键设备中关键部件的归一化风险值选取合适的风险管控措施,实现效益与安全的平衡,是风险管控策略关注的重点。为此,提出了基于深度强化学习的海洋石油平台水下采油树系统风险管控措施决策方法。以水下采油树系统为例,根据泊松过程量化由外部不确定因素引起的风险值增加,以生产收益和管控措施花费等为奖励,建立基于深度强化学习的风险管控措施决策方法,通过不断更新神经网络模型参数,学习单位时间收益较优的管控措施决策,并与基于阈值的风险管控策略相对比,探讨了各种失效惩罚和预防性维修、更换操作准备花费下对单位时间收益的影响。结果表明,该方法在平均单位时间收益上接近最优阈值策略,并在失效惩罚变化条件下表现出更小的收益降幅,说明其具有一定的灵活性与鲁棒性。本研究定位为基于仿真环境的风险管控方法验证研究,当前主要面向上层离线决策支持,不直接面向现场生产系统的在线自动闭环控制。

    Abstract:

    With the rapid expansion of offshore oil and gas development in China, offshore platforms are increasingly exposed to safety issues caused by harsh operating environments and the progressive manifestation of inherent equipment defects. How to select appropriate risk control measures based on the normalized risk values of key components in critical equipment, so as to achieve a balance between safety and economic benefit, has become a major concern in risk control strategy design. To address this issue, a deep reinforcement learning-based decision-making method for risk control measures in subsea tree system on offshore oil and gas platforms is proposed. Taking the subsea tree system as an example, the increase in risk value induced by external uncertain factors is quantified using a Poisson process. With production revenue and the costs of risk control measures incorporated into the reward function, a deep reinforcement learning-based decision-making framework is established. By continuously updating the neural network parameters through interactions with the environment, the method learns risk control decisions with favorable revenue per unit time. The proposed method is compared with threshold-based risk control strategies, and the effects of different failure penalties as well as preparation costs for preventive maintenance and replacement operations on revenue per unit time are further investigated. The results show that the proposed method achieves performance close to that of the best threshold-based strategy in terms of average revenue per unit time, while exhibiting a smaller reduction in revenue under varying failure penalty conditions, indicating a certain degree of flexibility and robustness. This study is positioned as a simulation-based validation of a risk control method and is currently intended for upper-level offline decision support rather than online automatic closed-loop control in field production systems.

    参考文献
    相似文献
    引证文献
引用本文

葛伟凤,陈明新,何睿,等. 基于深度强化学习的水下采油树系统风险管控决策方法[J]. 科学技术与工程, , ():

复制
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-03-17
  • 最后修改日期:2026-06-09
  • 录用日期:2026-07-27
  • 在线发布日期:
  • 出版日期:
×
2026年会通知 | “技术经济学驱动智能经济生态构建与治理变革”——中国技术经济学会第三十三届学术年会(2026)会议通知暨征文启事(第一轮)
亟待确认版面费归属稿件,敬请作者关注