본문 바로가기

DDPG 알고리즘을 이용한 양팔 매니퓰레이터의 협동작업 경로상의 특이점 회피 경로 계획

Singularity Avoidance Path Planning on Cooperative Task of Dual Manipulator Using DDPG Algorithm

문서 유형
연구출판물 · 학술지 논문
등재
KCI
저널 순위
KCI Q4
저널
로봇학회 논문지16(2) · pp.137 · 2021
피인용
KCI 4
ISSN
1975-6291

저자

  1. 이종학제1저자부산대학교
  2. 김경수부산대학교
  3. 김윤재부산대학교
  4. 이장명교신저자부산대학교

초록

When controlling manipulator, degree of freedom is lost in singularity so specific joint velocity does not propagate to the end effector. In addition, control problem occurs because jacobian inverse matrix can not be calculated. To avoid singularity, we apply Deep Deterministic Policy Gradient(DDPG), algorithm of reinforcement learning that rewards behavior according to actions then determines high-reward actions in simulation. DDPG uses off-policy that uses -greedy policy for selecting action of current time step and greed policy for the next step. In the simulation, learning is given by negative reward when moving near singulairty, and positive reward when moving away from the singularity and moving to target point. The reward equation consists of distance to target point and singularity, manipulability, and arrival flag. Dual arm manipulators hold long rod at the same time and conduct experiments to avoid singularity by simulated path. In the learning process, if object to be avoided is set as a space rather than point, it is expected that avoidance of obstacles will be possible in future research.

키워드

Dual Armed ManipulatorSingularityReinforcement LearningDDPG

식별자

KCI
ART002719583