Polaris is a web-based multiplayer fitness platformer that turns your body into the game controller. Jump, run, and crouch in real life to control your polar bear avatar through snowy obstacle courses—all powered by real-time computer vision.
Think Xbox Kinect, but rebuilt with modern machine learning and a fresh, web-native stack.
🏆 1st Place – Best Game Hack @ Hack the 6ix 2025
🎖 Finalist – Overall Top 8
Polaris combines motion tracking, gesture recognition, and real-time multiplayer gameplay into a joyful fitness game:
- 🧍♂️ Full-body Pose Detection – Supports 2 players from 1 webcam
- ✋ Sliding Window Gesture Recognition – Detects run, jump, crouch with confidence scoring
- 🌐 Multiplayer Engine – Real-time sync via WebSockets
- 🧊 3D Platformer – Custom game engine in Three.js, runs smoothly in-browser
| Layer | Technology |
|---|---|
| ML Pose Recognition | Mediapipe + Custom Gesture Logic |
| Multiplayer Backend | FastAPI + WebSockets |
| Frontend Game Engine | React + Three.js |
- 👥 Dual-player support via a single camera
- 🏃 Real-life movements control in-game actions
- 🧠 Confidence-weighted gesture detection
- 🌎 Multiplayer matchmaking + sync engine
- 🎮 Fully custom 3D level with physics
- 🔥 Real-time energy/calorie estimation (WIP)