HGIC: A Hand Gesture Based Interactive Control System for Efficient and Scalable Multi-UAV Operationss

Mengsha Hu, Jinzhou Li, Runxiang Jin, Chao Shi, Lei Xu, Rui Liu

This repository contains the code for the paper HGIC

Code Structure

• hand_recognition folder contains the code for hand gesture recognition.
• swarm_controller folder contains the code for swarm control.
• settings.json file contains the settings for the AirSim simulator.

Requirements

• Install by running the following command.

  git clone https://github.com/kingchou007/HGIC_Platform

• Environment

  pip install -r requirements.txt

AirSim Download and Installation

Please follow the instructions in the AirSim website to download and install the AirSim simulator.

Once you have installed the AirSim simulator, please replace the settings.json file in the Documents/AirSim folder with the settings.json file in the AirSim folder in this repository.

Running the Code

Please open the AirSim simulator. Then, Open two terminals and run the following commands in each terminal.

Terminal 1:

cd hand_recognition # Path: hand_recognition
python3 main.py

Terminal 2:

cd swarm_controller # Path: swarm_controller
python connect.py

License

This project is licensed under the MIT License - see the LICENSE file for details.

Acknowledgements

• AirSim
• Google Media-Pipe