Skip to content

Latest commit

 

History

History
22 lines (11 loc) · 869 Bytes

README.md

File metadata and controls

22 lines (11 loc) · 869 Bytes

Gestures to Bash

This repo attempts to use mediapipe Hands-API to detect human gestures and execute Bash commands. The "proof of concept" is to accomplish a sci-fi kind of ux running "xdotool" in every gesture and navigate in a Linux interface.

The project is made as a playground where you can parse static and moving gestures of your own and assign them any bash command you want (of course is a requirement to install anything you might want to use, such as xdotool).

This can be done as follows:

python moving_gesture_parser.py swipeleft xdotool key super+Left

python gesture_gesture_parser.py ok gnome-terminal

Then running:

python main.py

you can try them out.

Heres a video preview

demo.webm.mov