Build Real-Time Data Pipelines with Azure Event Hub & Databricks

Build Real-Time Data Pipelines with Azure Event Hub & DatabricksBuild Real-Time Data Pipelines with Azure Event Hub & Databricks

The network for creativity

Join 1.25M professional creatives like you

Connect with clients, get discovered, and run your business 100% commission-free

Creatives on Contra have earned over $150M and we are just getting started

Back to feedPost

Madhavi Akella

• May 25

Real-Time Streaming Pipeline: Fault-tolerant real-time data pipeline reducing data latency from 12+ hours to under 60 seconds. Built on Azure Event Hub and Databricks Structured Streaming with exactly-once processing semantics via checkpointing. Implemented watermarking for late-arriving data and Delta Lake sink for concurrent dashboard reads. Tech: Azure Event Hub, Databricks Structured Streaming, PySpark, Delta Lake, ADLS Gen2.

Completed work

Data Engineering Databricks PySpark Azure

RANJAY Kumar

• May 28

I automated a business workflow using SQL + Excel by connecting multiple Excel files into one system, creating automated data refreshes, building a live dashboard, and scheduling automatic reports — eliminating manual work and saving hours every week.

Microsoft Excel Business Consulting Data Analysis Business Workflow Automation Microsoft Power BI SQL

Saurabh Rajvanshi

• May 28

AI Lead Automation — Webhook to CRM Pipeline: Built a fully automated lead capture system for a private capital firm. Form submission triggers a webhook → logs to Google Sheets → sends a branded HTML email notification via Zoho Mail. Built on Make.com with zero manual intervention. End-to-end pipeline runs in under 10 seconds.

Completed work

Low-Code/No-Code Development Business Workflow Automation Google Sheets Make Zoho One

Quentine Nduati

• May 28

VerseFlow: Real-Time Verse Detection & Display System

Designed and developed VerseFlow, a real-time transcription and display system that detects spoken Bible verses during live sermons and instantly syncs them to sanctuary display screens.

Built with Next.js, Mantine UI, Node.js, Express, PostgreSQL, Drizzle ORM, Zustand, and WebSockets (Socket.io) for real-time communication between the media dashboard and public display screens.

Implemented speech recognition workflows, offline-first PWA support, intelligent verse parsing, and a human-in-the-loop confirmation system optimized for high-pressure live media environments.