A camera music playground
Make music with hand gestures.
Gesture music turns movement into musical control. Choose individual piano notes, a continuous theremin tone, or the hand-shaped chords you can play here.
Notes, glides or chords?
| Instrument | What your hands do | Best starting task |
|---|---|---|
| Air piano | Lower either index fingertip onto virtual keys. | Play a short melody with separate notes. |
| Online theremin | Move the right palm for pitch and the left for volume. | Hold one tone and glide smoothly to another. |
| Gesture Synth chords | Choose a root with the left hand and a chord shape with the right. | Make a four-chord loop, then record 15 seconds. |
What is hand gesture music?
Instead of pressing a physical key, you move a hand or change its shape to control a musical parameter. A useful mapping makes that relationship predictable: position can choose a note, height can change volume, and finger count can select a chord.
This camera music app tracks hand landmarks in your browser and sends musical instructions to a local synthesizer. It generates sound from your movements; it does not listen to a microphone or turn a recorded video into a finished song.
A first hand-controlled chord loop
In the chord instrument above, keep the key on C. Start the camera and put your left hand in lane I. Show one extended finger on your right hand, then raise that palm until you hear C major.
ChordsC → G → Am → F
Left-hand lanesI → V → VI → IV
Right-hand fingers1 → 1 → 2 → 1
Pause briefly after each change so the tracker can settle. The left hand chooses the root; it does not automatically choose a major or minor chord. Keep the right-hand shape deliberate. Use the complete chord reference for other qualities and keys.
When the loop is comfortable, move the right palm up and down for volume and sideways for a darker or brighter filter. The optional recorder captures a 15-second performance when supported by your browser.
Make the camera work for your hands
Place the device on a stable surface and light your hands from the front. Keep fingers and palms within the picture, with space between your hands. A plain background and slower movements make the controls easier to learn.
The camera is requested only after you press Start camera, and microphone access is not requested. Camera frames are processed locally. Browser compatibility, device speed and lighting affect tracking; the recognition troubleshooting guide explains common problems.
If you prefer to play without a camera, the virtual piano keyboard and theremin touch pad and sliders provide direct controls. For a Spanish introduction to the chord instrument, visit el sintetizador con las manos.