Projects using Docker in New DelhiProjects using Docker in New DelhiLLM Guardrails Gateway — Local LLM Security
Built a secure AI gateway using Python, FastAPI, Ollama, and Qwen2.5-Coder 7B. It protects LLM requests using PII detection, secret scanning, prompt injection and jailbreak detection, semantic safety checks, risk scoring, redaction, rate limiting, and audit logging. I also built a dashboard to show guardrail status, blocked threats, and request history.