Free online gesture controller
Gesture Controller is a browser-based computer vision tool that turns simple hand movements into actions. It uses MediaPipe Hands to track hand landmarks and a lightweight gesture-recognition layer to interpret those landmarks.
Supported hand gestures
- Pinch: thumb and index finger close together triggers Click.
- Open palm: an open hand triggers Pause.
- Point right: triggers Next.
- Point left: triggers Back.
- Point up/down: triggers directional actions.
How to use the Gesture Controller
- Place your webcam where your hand is clearly visible.
- Click Start Camera and allow camera access.
- Show one hand to the camera.
- Try one of the gestures shown beside the video.
- The detected gesture and action appear in the activity list.
How it is built
The tool uses MediaPipe Hands to estimate 21 hand landmarks. The gesture recognizer compares fingertip and joint positions, finger-extension states, pinch distance and short-term hand movement. A small cooldown prevents one gesture from firing repeatedly while the hand remains in the same pose.
What can you use gesture control for?
Gesture controls are useful for browser experiments, presentations, media interfaces, accessibility prototypes, interactive displays, touch-free kiosks and creative web projects. This demo maps gestures to actions within the webpage.
Can it control your entire computer?
A normal webpage cannot freely send mouse clicks or keyboard commands to your operating system because of browser security restrictions. This tool therefore demonstrates gesture-controlled actions inside the webpage. A desktop companion application could extend the same hand-tracking concept to system-wide controls.
Privacy and limitations
Hand tracking runs in your browser after the model loads. Camera access requires your permission. Lighting, hand position, motion blur, occlusion and multiple hands can affect recognition. Gesture recognition is approximate and should not be relied upon for safety-critical controls.
Gesture Controller FAQ
What is a gesture controller?
It is a computer-vision interface that recognizes hand movements and maps them to digital actions.
How does this gesture controller work?
MediaPipe Hands detects 21 hand landmarks. JavaScript then analyzes those landmarks and recent movement to classify simple gestures.
Can it control my whole computer?
Not directly from a normal webpage. Browser security limits operating-system control. This demo triggers actions within the webpage.
Does it upload my camera?
The hand-tracking model runs in the browser, so server-side video processing is not required for recognition.
Why is my gesture not recognized?
Try moving closer to the camera, improving lighting, keeping your entire hand visible and making gestures more deliberately.