Varun1511/chatbot_evolution_submission

🩺 Multilingual Medical AI Assistant

👋 Hello! This is my submission for the Chatbot Evolution Competition.

Meet our Multilingual Medical AI Assistant – a powerful multimodal AI system that can analyze medical images and interact with users via text and realistic voice, in both English and Hindi. 🌐🧠🎤

💡 What It Can Do

✅ Analyze medical images (X-rays, scans, etc.) ✅ Understand voice input in Hindi and English ✅ Respond with text and voice output ✅ Give smart, LLM-powered insights ✅ Act as a virtual multilingual doctor assistant

🧠 Powered By

• —Groq API for blazing-fast LLM inference
• —Meta's LLaMA 3 Vision for text + image understanding
• —OpenAI Whisper for accurate speech-to-text
• —gTTS & ElevenLabs for voice generation
• —Gradio for a clean and interactive UI
• —deep_translator for translation between Hindi/English

⚙️ Architecture Overview

1. 1.Phase 1 – Brain of the Doctor → Groq + LLaMA 3 Vision processes both image and text

1. 1.Phase 2 – Voice of the Patient → Whisper captures and transcribes Hindi/English speech

1. 1.Phase 3 – Voice of the Doctor → gTTS + ElevenLabs generate natural, human-like responses

1. 1.Phase 4 – User Interface → Built with Gradio – just speak, upload, and interact!

🌍 Why This Matters

💬 Multilingual support is critical in healthcare, especially for rural populations in India and beyond. 🧑‍⚕️ This AI assistant bridges that gap by offering inclusive, accessible, and intelligent support – without the language barrier.

🎥 Demo

Click "Open in Spaces" to try it out live!

Upload a medical image and ask questions in your preferred language.

📦 Installation (Local)

If you want to run this locally:

git clone https://huggingface.co/spaces/your-username/medical-ai-assistant
cd medical-ai-assistant
pip install -r requirements.txt
python app.py