AI Policy Review Service: Empty Repo to Production, 7 Weeks

An AI service that reviews renewing insurance policies for brokers. It went from an empty repo to production in seven weeks, and I later cut its cost per run by 68% and halved its run time.

AI agents each check one part of a policy, such as the premium or the coverages, after a step swaps personal data for placeholders. Evals on every step scored five models, and each step moved to the one that scored best. Rate limits and fair scheduling keep one busy customer from slowing the rest, and dashboards and traces show cost and speed per call.