Built the architecture behind Dervale, by Harmanpreet .Built the architecture behind Dervale, by Harmanpreet .

Built the architecture behind Dervale,

Harmanpreet .

Harmanpreet .

Built the architecture behind Dervale, a multi-tenant AI gateway designed to give applications one unified API for working with multiple AI providers.
The platform is built around a Java + Spring Boot backend with:
• OpenAI-compatible API access • Multi-provider routing and fallback • JWT authentication, API keys, workspaces and RBAC • Usage metering, budgets, quotas and rate limiting • PostgreSQL + Redis for persistent and runtime data • Request, audit and security logging • Cost, token and latency observability • Response caching and guardrails • Billing and account controls
The goal was to make AI infrastructure easier to operate: one gateway for routing, governance, observability and access control instead of implementing each provider independently.
This architecture was designed with maintainability, tenant isolation and future provider expansion in mind.
Stack: Java, Spring Boot, React, PostgreSQL, Redis, Docker
Like this project

Posted Aug 14, 2026

Built the architecture behind Dervale, a multi-tenant AI gateway designed to give applications one unified API for working with multiple AI providers. The pl...