Built the architecture behind Dervale, a multi-tenant AI gateway designed to give applications one unified API for working with multiple AI providers.
The platform is built around a Java + Spring Boot backend with:
• OpenAI-compatible API access
• Multi-provider routing and fallback
• JWT authentication, API keys, workspaces and RBAC
• Usage metering, budgets, quotas and rate limiting
• PostgreSQL + Redis for persistent and runtime data
• Request, audit and security logging
• Cost, token and latency observability
• Response caching and guardrails
• Billing and account controls
The goal was to make AI infrastructure easier to operate: one gateway for routing, governance, observability and access control instead of implementing each provider independently.
This architecture was designed with maintainability, tenant isolation and future provider expansion in mind.
Stack: Java, Spring Boot, React, PostgreSQL, Redis, Docker

0 likes · 8 views · Aug 14, 2026
Built the architecture behind Dervale, a multi-tenant AI gateway designed to give applications one unified API for working with multiple AI providers. The pl...