Gesture-Based Teleoperation Assisting Load Transportation Tasks

Authors

  • Felipe dos A. Rezende Núcleo de Especialização em Robótica (NERo), Universidade Federal de Viçosa, Viçosa – MG
  • Celso O. Barcelos Programa de Pós-Graduação em Ciência da Computação, Universidade Federal de Viçosa, Viçosa – MG
  • Leonardo A. Fagundes-Júnior Programa de Pós-Graduação em Ciência da Computação, Universidade Federal de Viçosa, Viçosa – MG
  • Alexandre S. Brandão Departamento de Engenharia Elétrica, Universidade Federal de Viçosa, Viçosa – MG

DOI:

https://doi.org/10.20906/CBA2024/4250

Keywords:

UAV, Gesture, Load Transportation, Human-Robot Interaction

Abstract

Research in sensing, battery technology, and image processing has driven advancements in aerial robotics, enabling the utilization of these vehicles in various domains. This work aims to employ gestures performed by a human operator to control unmanned aerial vehicles (UAVs), during load transportation tasks. For a better elucidation of the practical development, this research was divided into four stages. Initially, reflective markers were attached to the operator’s hands and a predefined reference point was used, aiding in defining the hands’ operating area and their movement relative to the operator’s motions. These markers are tracked by a motion tracking system, and the data is processed using OptiTrack’s Motive software. Subsequently, this data is exported to Matlab, where it is processed and used for drone control, specifically the Bebop 2 by Parrot Inc. In the following stages, individual UAV control is performed, followed by UAV control while carrying an electromagnet. Finally, to enhance the UAV localization perception, the UAVs camera view is made available to provide visual feedback to the operator, facilitating the control task. Experimental tests demonstrate the system’s capability for human-robot interaction in load collection, transportation, and delivery.

Downloads

Published

2024-10-18

Issue

Section

Articles