Built an intelligent LLM routing by Azeem Husain KhanBuilt an intelligent LLM routing by Azeem Husain Khan

Built an intelligent LLM routing

Azeem Husain Khan

Azeem Husain Khan

Built an intelligent LLM routing system that dynamically discovers and evaluates available models, performs health and rate-limit checks, and routes each request to the most suitable model based on capability, latency, availability, and cost. The system supports automatic failover and manual model selection through a Streamlit dashboard, providing a practical AI gateway for reliable and cost-efficient LLM applications.
Like this project

Posted Sep 1, 2026

Built an intelligent LLM routing system that dynamically discovers and evaluates available models, performs health and rate-limit checks, and routes each req...