A futuristic real-time hand-tracking AR experience built using MediaPipe + JavaScript. This project transforms your hand movements into dynamic neon visuals, particle effects, gesture-based interactions, and reactive audio.
neon-hand-gesture-visualizer/
│
├── index.html # Main UI structure
├── main.js # Core logic (hand tracking, effects, audio)
├── app.css # Styling & UI design
├── LICENSE
└── README.md # Project documentation- Uses MediaPipe Hands
- Detects up to 2 hands simultaneously
- Tracks 21 landmarks per hand
- 🤏 Pinch Detection (Thumb + Index)
- ✋ Open Hand Detection
- ✊ Fist Detection
- Live gesture feedback on screen
- Glowing hand skeleton rendering
- Dynamic color themes
- Smooth motion trails
- Gradient-based lighting effects
- 💥 Shockwave effect on pinch
- ✨ Particle system from fingertips
- ⚡ Lightning between both hands
- 🌀 Mandala-style pattern rendering
- Animated matrix rain effect
- Speed reacts to hand movement velocity
- Creates immersive cyberpunk feel
- Built using Web Audio API
- 🎵 Ambient hum sound (based on hand distance)
- ⚡ Zap sound on pinch gesture
- Real-time audio modulation
- Rainbow 🌈
- Cyberpunk 💜
- Lava 🔥
- Ocean 🌊
- Galaxy 🌌
- Hands detected
- FPS counter
- Current gesture
- Hand spread %
| Technology | Role |
|---|---|
| JavaScript | Core logic & interaction |
| MediaPipe Hands | Hand tracking (AI model) |
| HTML5 Canvas | Rendering visuals & effects |
| Web Audio API | Sound generation |
| CSS3 | UI styling (Glassmorphism) |
- Modern browser
- Webcam access required
- Internet (for CDN libraries)
git clone https://github.com/ShakalBhau0001/neon-hand-gesture-visualizer.gitcd neon-hand-gesture-visualizer- Open
index.htmlin browser - Allow camera permission
- Click Enter Experience
- 🎥 Live camera feed (mirrored)
- ✋ Hand skeleton with neon glow
- ✨ Particles from fingertips
- ⚡ Lightning between hands
- 🌧️ Matrix-style animated background
- 📊 Live HUD with stats
- MediaPipe processes video frames
- Detects hand landmarks in real-time
- Calculates distance between fingers
- Identifies pinch, open hand, fist
-
Canvas draws:
- Skeleton
- Particles
- Shockwaves
- Lightning
- Generates real-time sound
- Reacts to gesture & hand distance
- Requires good lighting for accurate detection
- Performance depends on device GPU/CPU
- Mobile support limited
- 📱 Mobile optimization
- 🧠 More advanced gestures
- 🌐 Three.js 3D integration
- 🎥 Recording / export feature
- 🎮 Gesture-based controls
Creator: Shakal Bhau
GitHub: ShakalBhau0001
If you like this project:
- ⭐ Star the repo
- 🍴 Fork it
- 🚀 Share it
✨ Move your hands. Create magic. ✨