The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
End-to-End Automated Web Scraping & Google Sheets Data Pipeline
Built an automated data collection and logging system where a Python script scrapes book details (titles, prices, and stock availability) from target websites and pushes payloads via webhook to an n8n workflow. The workflow processes the data using Split Out nodes, automatically appends structured records into Google Sheets, and triggers instant confirmation notifications.
#n8n #Python #WebScraping #GoogleSheets #Webhooks #WorkflowAutomation #DataPipeline
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Challenges
View all
Related posts
Enterprise RAG AI: Private Doc Intelligence
A fast-growing B2B software firm needed a secure, enterprise-grade Retrieval-Augmented Generation (RAG) system to query thousands of confidential internal documents (legal contracts, technical architecture specs, Notion pages, and employee SOPs) in real time without third-party data leakage.
Key Challenges:
High hallucination risk and irrelevant context retrieval using standard keyword search.
Managing multi-format files (scanned PDFs, tables, markdown) with strict access control based on user hierarchy.
Technical Implementation & Solution:
• Engineered an automated ingestion pipeline in Python with LlamaIndex and LangChain for semantic chunking and metadata preservation.
• Integrated a hybrid vector search architecture pairing dense embeddings (OpenAI text-embedding-3) with sparse BM25 indexing in Qdrant.
• Added a cross-encoder re-ranking layer (Cohere Re-ranker) to prune low-relevance chunks, reducing API token costs by 40%.
• Built robust Role-Based Access Control (RBAC) via FastAPI endpoints, ensuring departmental data isolation.
Results & Impact:
• Dropped internal information retrieval time from 20 minutes to under 4 seconds.
• Attained 98% factual precision with traceable in-line page citations.
• Full on-prem Docker deployment ensuring 100% private data security.
I'd test revoking a user's document access mid-conversation. In your RBAC flow, do cached retrieval results get rechecked against current permissions before they're sent to the reranker or model?
Looking for Data Entry & Virtual Assistant Projects
Hi everyone! 👋
I’m Aneetha, a Virtual Assistant specializing in:
• Data Entry & Data Collection
• Excel & Google Sheets
• Web Research
• Data Cleaning & Organization
• Admin Support
I’m available for both short-term tasks and ongoing projects.
If you need reliable and accurate support, feel free to connect with me. 😊
Hello I am interested this work
𝐀𝐈 𝐀𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 & 𝐁𝐮𝐬𝐢𝐧𝐞𝐬𝐬 𝐎𝐩𝐞𝐫𝐚𝐭𝐢𝐨𝐧𝐬 𝐃𝐚𝐬𝐡𝐛𝐨𝐚𝐫𝐝
Atomie™ is a modern AI-powered automation dashboard designed to help businesses simplify complex workflows, reduce repetitive manual work, and make better operational decisions.
The platform brings AI automation, workflow management, performance analytics, and business insights into one clean and intuitive interface. Instead of managing disconnected tools and repetitive processes, teams can use a centralized dashboard to monitor operations, automate tasks, and understand what is happening across their business.
What I Built
AI-powered business automation dashboard
Workflow and task automation interfaces
Real-time performance and operational insights
Clean, responsive dashboard experience
Intuitive navigation for complex business processes
AI-focused UX designed around simplicity and usability
Scalable interface structure for future automation features
The Goal
The main goal was to make advanced AI automation feel simple and accessible. The interface was designed to reduce complexity while giving businesses a clear overview of their workflows, performance, and automation activity.
Atomie™ demonstrates how AI, automation, and modern product design can come together to create a smarter operating experience for growing businesses.
Focus: AI Automation · Business Operations · SaaS Dashboard · Workflow Automation · Product UI/UX · AI Systems
Nice work