VAANI - AI Voice Assistant for Government Services
Roshan Kumar Singh
🎙️ VAANI - Voice-First Civic Engagement Platform
AI-Powered Voice Assistant for Government Services & Civic Complaints
📖 Overview
VAANI is a comprehensive voice-first platform designed to bridge the gap between citizens and government services. It leverages cutting-edge AI technology to provide multilingual voice assistance for filing civic complaints, tracking issues, and accessing government schemes.
🎯 Key Highlights
🗣️ Multilingual Support: Seamlessly handles Hindi, English, and Hinglish
🎤 Voice-First Design: Natural voice interactions powered by AWS Transcribe & Polly
🤖 AI-Powered: Intelligent responses using AWS Bedrock Nova Sonic
📊 Real-Time Analytics: Interactive dashboards with live data visualization
🔐 Secure Authentication: Firebase-based user management
📱 Fully Responsive: Optimized for mobile, tablet, and desktop
♿ Accessible: WCAG-compliant design principles
🌟 Live Demo
Visit my portfolio: https://vaani-ai-assistant-419de.web.app
✨ Features
🎙️ Voice Assistant
Natural Language Processing: Understands context and intent
Multi-turn Conversations: Maintains conversation history
Language Detection: Automatically detects user's preferred language
Voice Commands: Hands-free interaction for accessibility
Real-time Transcription: Instant speech-to-text conversion
Neural Voice Synthesis: Natural-sounding responses
📝 Civic Engagement
Complaint Filing: Easy submission of civic issues
Issue Tracking: Real-time status updates
Category Management: Healthcare, Legal, Education, Welfare
Priority Handling: Urgent issues flagged automatically
Historical Records: Complete activity history
📊 Analytics & Insights
Interactive Charts: Issue distribution and trends
Performance Metrics: Resolution rates and response times
User Activity: Comprehensive activity tracking
Admin Dashboard: System-wide analytics and monitoring
🔒 Security & Privacy
Firebase Authentication: Secure user management
Role-Based Access: User and Admin roles
Data Encryption: End-to-end security
Privacy Compliance: GDPR-ready architecture
🎤 Supported Voice Queries
VAANI understands natural voice queries from citizens in English and Hinglish. Below are some example questions the assistant can handle.
👋 General Interaction
Tum kaun ho?
Vaani kya hai?
Tum kya madad kar sakte ho?
Namaste
Mujhe madad chahiye
Mai bahut pareshan hu
Mujhe kuch poochna hai
Aapka naam kya hai?
Dhanyavaad
Alvida
🏙️ Civic Issues & Complaints
Complaint kaise kare?
Complaint status kaise check kare?
Sadak tut gayi hai kya kare?
Street light kharab hai kya kare?
Pani nahi aa raha kya kare?
Kachra nahi uth raha kya kare?
Sewer overflow ho raha kya kare?
Bijli nahi aa rahi hai
👤 Account & System
Account kaise banaye?
🏛️ Government Schemes
Sarkari yojna kya hai?
Ujjwala yojna kya hai?
Ayushman card ke liye eligible kaun hai?
How to make Ayushman card?
🚀 Quick Start
Prerequisites
Node.js 20+ (Download)
Python 3.11+ (Download)
AWS Account with Bedrock access
Firebase Project (Setup Guide)
1️⃣ Clone Repository
2️⃣ Frontend Setup
🌐 Frontend runs on: http://localhost:5173
3️⃣ AI Backend Setup (Node.js)
🚀 Backend runs on: http://localhost:5000
4️⃣ Python Backend Setup (Optional)
🐍 Python server runs on: http://localhost:8000
5️⃣ FastAPI Backend Setup
⚡ FastAPI runs on: http://localhost:8080
📁 Project Structure
🏗️ Architecture
System Overview
Technology Stack
Layer Technology Purpose Frontend React 18, Vite, Tailwind CSS User interface UI Components Framer Motion, Recharts, Lucide Icons Animations & visualizations Backend Node.js, Express, FastAPI API servers AI/ML AWS Bedrock Nova Sonic Natural language processing Voice AWS Transcribe, Polly Speech-to-text & text-to-speech Authentication Firebase Auth User management Storage AWS S3 Audio file storage Deployment AWS Amplify, Lambda Serverless infrastructure State Management React Context API Global state Routing React Router v7 Client-side routing
📚 Documentation
Core Documentation
📐 Architecture Guide - System design and infrastructure
🎤 Voice Assistant Guide - Voice features and integration
🧪 Voice Assistant Testing - Testing procedures
📊 Project Status - Current development status
☁️ AWS Quota Guide - AWS service limits
Backend Documentation
📖 AI Backend README - Node.js backend setup
🐍 Python Backend README - Python backend setup
⚡ FastAPI Backend README - Authentication backend
Training & Testing
🎓 Training Guide - AI model training
✅ Test Summary - Test results
📝 Questions Guide - Supported queries
🧪 Testing
Frontend Testing
Backend Testing
Python Backend Testing
🔧 Configuration
Environment Variables
Frontend (.env)
AI Backend (.env)
FastAPI Backend (.env)
📊 Dataset
Training Data
Active Dataset:
training-dataset.json (61 conversations)Backup Dataset:
training-dataset-backup-213.json (213 conversations)Languages: Hindi, English, Hinglish
Categories: Healthcare, Legal, Education, Welfare, Government Schemes
Dataset Statistics
✅ Training Accuracy: 100%
✅ Language Detection: Working
✅ Intent Classification: Optimized
✅ Response Cache: Active
🎯 Current Status
✅ Completed Features
Voice assistant with multilingual support
User authentication and authorization
Admin and user dashboards
Interactive analytics charts
Issue tracking system
Responsive design (mobile, tablet, desktop)
AWS Amplify integration
Firebase authentication
Training data optimization (100% accuracy)
Response caching system
Language detection
Intent classification
🚧 In Progress
Real-time notifications
Advanced analytics
Multi-region deployment
Performance optimization
🔮 Planned Features
Mobile app (React Native)
Offline mode
Advanced AI models
Community forums
Video support
🚀 Deployment
AWS Amplify Deployment
Manual Deployment
Frontend (Vercel/Netlify)
Backend (AWS Lambda)
🤝 Contributing
We welcome contributions! Please follow these steps:
Fork the repository
Create a feature branch:
git checkout -b feature/amazing-featureCommit changes:
git commit -m 'Add amazing feature'Push to branch:
git push origin feature/amazing-featureOpen a Pull Request
Development Guidelines
Follow existing code style
Write meaningful commit messages
Add tests for new features
Update documentation
Ensure responsive design
📝 Scripts Reference
Frontend Scripts
AI Backend Scripts
🐛 Troubleshooting
Common Issues
Issue: Voice assistant not responding
✅ Check AWS credentials in
.env✅ Verify Bedrock access in AWS console
✅ Check browser microphone permissions
Issue: Authentication failing
✅ Verify Firebase configuration
✅ Check
serviceAccountKey.json✅ Ensure Firebase project is active
Issue: Charts not displaying
✅ Check console for errors
✅ Verify Recharts installation
✅ Clear browser cache
📄 License
This project is licensed under the MIT License - see the LICENSE file for details.
👥 Team
Built with ❤️ by the VAANI Team
🙏 Acknowledgments
AWS for cloud infrastructure
Firebase for authentication
React community for amazing tools
Open source contributors
📞 Support
For support, email vaani.voice.assist@gmail.com or join our Slack channel.
Made with 💜 by VAANI Team
Like this project
Posted Mar 30, 2026
Developed a voice assistant platform enhancing citizen access to government services.
Likes
0
Views
0
