RGB-D 카메라 기반 로봇 원격제어를 위한 손 추적 신호 안정화 시스템 개발

Development of a Hand-Tracking Signal Stabilization System for RGB-D Camera-Based Robot Teleoperation
  • 류영재; 
  • 이건우; 
  • 박세준; 
  • 김언; 
  • 정영석; 
  • ... 이호수; 
  • 외 1명

초록

This study proposes a multi-stage signal stabilization structure for RGB-D camera-based robot arm teleoperation using hand-tracking information. Vision-based hand tracking with MediaPipe Hands provides a contactless input method for multi-degree-of-freedom robot control, but directly applying raw tracking results to robot commands can cause unintended command changes and unstable motion. To address this, stabilization processes are applied at three stages of the control pipeline: vision-based hand control input, robot target command and trajectory, and joint command continuity. The proposed structure was evaluated on a robot arm teleoperation system through Hold Jitter and Pick-and-Place experiments under Filter-OFF and Filter-ON conditions. In the Hold-Jitter experiment, XYZ command jitter decreased from 1.675 mm to approximately 0 mm, while Roll/Pitch command jitter was reduced by 56.2%. In the Pick-and-Place task, the first-attempt success rate increased from 33.3% to 63.3%, and the mean task completion time was reduced by 37.9%. These results, based on three participants, indicate reduced command fluctuations and a positive trend toward improved teleoperation performance.

키워드

로봇 원격제어; 손 추적; 신호 안정화; RGB-D 카메라; 미디어파이프 핸즈; 로봇팔 제어; Robot Teleoperation; Hand Tracking; Signal Stabilization; RGB-D Camera; MediaPipe Hands; Robot Arm Control
제목
RGB-D 카메라 기반 로봇 원격제어를 위한 손 추적 신호 안정화 시스템 개발
제목 (타언어)
Development of a Hand-Tracking Signal Stabilization System for RGB-D Camera-Based Robot Teleoperation
저자
류영재; 이건우; 박세준; 김언; 정영석; 정환서; 이호수
DOI
10.17958/ksmt.28.5.202610.1084
발행일
2026-10
유형
Y
저널명
한국기계기술학회지
권
28
호
5
페이지
1084 ~ 1095