Evaluating RAG Assistants for Missing-Source DetectionEvaluating RAG Assistants for Missing-Source Detection
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
Kapil's avatar
Kapil Chauhan
• Oct 17
Some RAG questions should end with a request for a missing source.
For Shamrock Marketing, I built retrieval over technical PDFs and standards using Azure AI Search and Azure OpenAI. Answers link back to document and page citations.
When scoping this kind of assistant, I'd include questions the supplied documents cannot answer. For example, ask for a product specification that is never stated in the source material.
I'd expect the assistant to identify the missing specification and ask for the relevant document. A plausible number with an unrelated citation should fail that check.
For a client, this gives the pilot a concrete acceptance criterion: can staff tell which answers they can verify and which questions still need an expert?
Public case: https://kapilchauhan.netlify.app/case/shamrock-marketing.html
ragAI Engineer Azure

kapilchauhan.netlify.app

Shamrock Marketing: Technical knowledge RAG | Kapil Chauhan

A citation-backed RAG system for standards, workflows, and product knowledge

Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started