I built a privacy-first AI assistant that automatically resolves IT errors by extracting information from screenshots, searching knowledge bases, and generating solutions—while protecting sensitive client data.
Challenges
Manual troubleshooting delays: IT support teams spent hours searching through documentation for error solutions
Screenshot-based tickets: Users submitted error screenshots that required manual text extraction and analysis
Privacy risks: Existing tools sent sensitive client data to external APIs, violating compliance requirements
Knowledge fragmentation: Error solutions scattered across multiple PDFs, databases, and documentation sources
Escalation bottlenecks: No automated way to draft escalation tickets when solutions weren't found
Solution & Approach
Developed ARES (Automated Resolution & Escalation System) using LangGraph workflow orchestration with:
Vision LLM OCR: Ollama-based text extraction from error screenshots
Dual RAG System: Separate vector databases for errors (Oracle, MySQL, MITRE) and general knowledge
Smart PII Detection: Pattern-based filtering that distinguishes error codes from sensitive data
Interactive Workflow: LangGraph interrupts for user approval with automatic escalation on rejection
Advanced Document Processing: Docling v2 for PDFs with table/chart recognition
Real-time PII detection with 95% confidence scoring
Automated escalation drafting when solutions aren't found
25 test images validated for OCR accuracy
Ready to Build Your AI Agent?
I specialize in developing production-grade AI agents with LangGraph, RAG systems, and workflow orchestration. Whether you need document processing, intelligent automation, or privacy-focused AI solutions, I deliver scalable systems that work.