A web-based, voice-controlled assistant designed to help users with motor impairments navigate websites hands-free. Built using Azure Speech Services, Flask, and Vanilla JavaScript, this project enhances accessibility through real-time voice commands and feedback.
Many individuals with motor impairments face barriers when navigating the web due to the need for a mouse or keyboard. Existing assistive technologies are limited in flexibility or usability. This assistant leverages Azure Speech-to-Text to interpret spoken commands and interact with websites using JavaScript.
- 🎙️ Real-time speech recognition via Azure Speech Services
- 👂 Command-based navigation (scroll, click, search, etc.)
- 🗣️ Voice feedback using Web Speech API (TTS)
- 💡 Accessibility support via DOM manipulation
- ☁️ Azure-backed secure token handling
- 🎨 Dark mode, highlight links, adjust font sizes
- 🧪 Easily extendable with custom commands
Use voice commands like:
- "Scroll down"
- "Go to contact"
- "Increase text size"
- "Open help"
- "Click menu"
- "Read page"
- "Enable dark mode"
| Component | Tech Used |
|---|---|
| Frontend | HTML, CSS, JavaScript |
| Backend | Flask (Python) |
| Cloud | Azure Cognitive Services (Speech API) |
| Other | Web Speech API (TTS), .env for config |
📈 Future Scope 🎙️ Continuous recognition mode 🌐 Browser extension version 🌍 Multilingual support 📚 Integration with screen readers 🧠 AI-based command personalization
| Name | GitHub Username |
|---|---|
| Shobhana S | @Shobhanashankar |
| Ummadi Mythri Reddy | @UmmadiMythriReddy |
🙌 Acknowledgements
- Microsoft Azure AI for Accessibility
- Azure Speech SDK Docs Inspiration from accessibility advocates worldwide ❤️