Projects in KoilwarProjects in KoilwarMultimodal Video SEO & Content Intelligence Engine
Engineered an end-to-end, 100% offline Multimodal Video SEO & Strategy Intelligence system designed for high-volume content creators and media marketing agencies.
Core Multimodal AI Pipeline:
• Audio Intelligence (Whisper): Millisecond-precision speech-to-text, tone detection, cadence tracking, and keyword density analysis.
• Computer Vision & Thumbnail Scorer (OpenCV + Vision LLMs): Semantic scene identification, on-screen text extraction, and predictive A/B thumbnail clickability scoring.
• Strategic Logic & SEO Pack: Correlates audio and visual signals to compute weighted retention scores (Hook 35%, Keyword 25%, Visual 25%, Sentiment 15%) and automated metadata packages.
• Competitor Benchmarking: Automated transcript gap analysis to identify underserved search demand and audience retention triggers.
• Automated Client Reporting: Production-grade automated PDF audit generation with visual breakdown charts.
Tech Stack:
• Core: Python, FastAPI (Async Orchestration), OpenCV, FPDF2, SQLite
• AI & Local Models: OpenAI Whisper, Gemma / Local LLMs via Ollama, TextBlob
• Dashboard: Streamlit Analytical Interface Built an AI-powered web chat agent using Voiceflow to handle customer conversations and automate common website interactions.
The agent understands visitor intent, retrieves relevant information from a business knowledge base using RAG, generates context-aware responses, and takes actions based on the conversation.
It can handle FAQs, customer support, appointment scheduling, lead capture and qualification, customer information collection, issue reporting, and human handoff when needed.
I also designed the workflow to connect with business systems such as CRMs, calendars, email, notifications, helpdesks, databases, and Google Sheets.
The goal was to move beyond a simple chatbot and create a system that can understand conversations, access the right information, take useful actions, and keep business processes connected.
This setup can be adapted to different business workflows, knowledge bases, conversation flows, and integrations. 
