Dipen Modi
Backend Engineer (12y) building RAG & LLM AI systems.
New to Contra
Dipen is building their profile!
Week 5 of building DocuPulse AI — complete. This was the week it stopped being a clever demo and started becoming something you could actually run for paying clients.
A working AI feature and a production-ready AI system are very different things. The gap between them is...
Day 34 of building DocuPulse AI.
Today's problem is the one that would actually get a company sued.
DocuPulse analyzes confidential contracts. The moment two law firms use it, a hard rule kicks in: Firm A must never, ever see Firm B's data. Not their contracts, not their...
Day 33 of building DocuPulse AI.
Two people ask the same question differently: "What's the confidentiality period?" and "How long do confidentiality obligations last?" Same answer. But to a computer they're different strings — so a normal cache treats them as different questions...
Day 32 of building DocuPulse AI.
Today: if OpenAI goes down, the system keeps answering by falling back to a second provider. Sounds like a one-line feature. Testing it taught me two things I didn't expect.
First — I broke my OpenAI key to simulate an outage, and the system died...
Day 31 of building DocuPulse AI.
Simple question a client will always ask: "what does this cost to run?" Until today my honest answer was "…I'm not sure." Not good enough.
So now every AI query the system makes logs its token usage and calculates the exact cost. Turns out it's...