About the project

About Gesture Synth

Gesture Synth is an independent browser instrument that turns visible hand movement into chords, volume, and tone—without an account, download, or uploaded camera feed.

Why it exists

Music software often starts with a keyboard, a grid, or a long setup process. Gesture Synth explores a simpler question: can a person open a page, raise both hands, and make a musical result they understand within seconds? The project is designed as a playful instrument first and a technical demonstration second.

How the instrument works

Your left hand selects one of seven root-degree lanes by moving horizontally. Your right-hand finger count chooses Major, Minor, Dominant 7, Major 7, Sus4, or mute. The right wrist also shapes volume and filter. A stabilizer waits for a gesture to settle before changing the chord, which reduces accidental triggers.

Hand landmark detection and sound synthesis run in the browser with MediaPipe Tasks Vision, WebAssembly, Web Audio, and a canvas renderer. The optional 15-second recorder combines the rendered stage and synthesized audio into a local browser file.

Product principles

• Play before promotion: the homepage opens directly on the instrument instead of sending visitors through a marketing funnel.
• Visible feedback: root, chord, expression, hand guidance, and camera status stay on the same stage.
• Local by default: camera frames and recordings stay in the browser rather than being uploaded.
• Focused scope: Gesture Synth is one useful musical toy, not a thin directory of unrelated games.

Independence and attribution

Gesture Synth is an independent web project. It is not affiliated with Google, MediaPipe, Tone.js, or other similarly named gesture-music websites. Open-source libraries used by the project retain their respective licenses and notices.

Get in touch

For product feedback, accessibility issues, privacy questions, or rights concerns, visit the contact page or email privacy@gesturesynth.cc.