Title: Local RAG System - Private Document Q&A Description: Built a privacy-first document Q&A sy...Title: Local RAG System - Private Document Q&A Description: Built a privacy-first document Q&A sy...
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
Prince's avatar
Prince Maurya
• Jul 19
Title: Local RAG System - Private Document Q&A
Description: Built a privacy-first document Q&A system that lets users upload PDFs or text files and ask questions over their own documents.
The system ingests documents, splits them into chunks, creates local embeddings with Ollama, stores them in ChromaDB, retrieves relevant context, and generates answers using a local LLM.
The hardest part was connecting the full RAG pipeline cleanly: loading, chunking, embedding, retrieval, and answer generation while keeping everything local.
Outcome: A working private RAG app where no document data leaves the machine.
Tech: Python, LangChain, ChromaDB, Ollama, Streamlit, RAG, Vector Databases
GitHub: https://github.com/PRINCE2-AI/local-rag-ollama-chromadb
AI Agent EngineerResearchLangChainOllama
Post image
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started