Deep Reinforcement Learning Framework for Underwater Locomotion of Soft Robot

Guanda Li, Jun Shintake, Mitsuhiro Hayashibe

研究成果: Conference contribution

8 被引用数 (Scopus)

抄録

Soft robotics is an emerging technology with excellent application prospects. However, due to the inherent compliance of the materials used to build soft robots, it is extremely complicated to control soft robots accurately. In this paper, we introduce a data-based control framework for solving the soft robot underwater locomotion problem using deep reinforcement learning (DRL). We first built a soft robot that can swim based on the dielectric elastomer actuator (DEA). We then modeled it in a simulation for the purpose of training the neural network and tested the performance of the control framework through real experiments on the robot. The framework includes the following: a simulation method for the soft robot that can be used to collect data for training the neural network, the neural network controller of the swimming robot trained in the simulation environment, and the computer vision method to collect the observation space from the real robot using a camera. We confirmed the effectiveness of the learning method for the soft swimming robot in the simulation environment by allowing the robot to learn how to move from a random initial state to a specific direction. After obtaining the trained neural network through the simulation, we deployed it on the real robot and tested the performance of the control framework. The soft robot successfully achieved the goal of moving in a straight line in disturbed water. The experimental results suggest the potential of using deep reinforcement learning to improve the locomotion ability of mobile soft robots.

本文言語English
ホスト出版物のタイトル2021 IEEE International Conference on Robotics and Automation, ICRA 2021
出版社Institute of Electrical and Electronics Engineers Inc.
ページ12033-12039
ページ数7
ISBN(電子版)9781728190778
DOI
出版ステータスPublished - 2021
イベント2021 IEEE International Conference on Robotics and Automation, ICRA 2021 - Xi'an, China
継続期間: 2021 5月 302021 6月 5

出版物シリーズ

名前Proceedings - IEEE International Conference on Robotics and Automation
2021-May
ISSN(印刷版)1050-4729

Conference

Conference2021 IEEE International Conference on Robotics and Automation, ICRA 2021
国/地域China
CityXi'an
Period21/5/3021/6/5

ASJC Scopus subject areas

  • ソフトウェア
  • 制御およびシステム工学
  • 人工知能
  • 電子工学および電気工学

フィンガープリント

「Deep Reinforcement Learning Framework for Underwater Locomotion of Soft Robot」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル