The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
Description:
Designed and deployed an end-to-end real-time big data pipeline to process live vehicle positioning data. The architecture leverages Apache Spark Structured Streaming and Redpanda for high-throughput data ingestion and stream processing. Processed data is seamlessly stored in MongoDB and served to client applications via a custom, high-performance RESTful API built with FastAPI. The entire microservices environment was containerized and orchestrated using Docker Compose for reliable and scalable deployment.
Tools & Technologies (Tags):
Apache Spark, Redpanda (Kafka), MongoDB, FastAPI, Python, Docker Compose, Data Engineering, Stream Processing.
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Related posts
Designed and built a demand-responsive shared shuttle system for smart cities.
The system used user travel data to identify transportation demand and dynamically determine shared shuttle routes.
The work combined software engineering, transportation systems, and data-driven optimization and was documented in an IEEE-published research paper.
📊 Centralized HubSpot CRM Sales Pipeline & Performance Dashboard
When sales data is scattered across multiple spreadsheets and automation tools, business owners struggle to track their active deals, monitor representative performance, and forecast monthly revenue.
I configured and deployed this custom HubSpot CRM architecture to act as a single source of truth for an active sales team, directly connected to automated backend pipelines.
Key Architecture Features Built:
• Structured Deal Stages: Created customized pipelines tracking leads smoothly from "Inbound Inquiry" to "Qualified Assessment" to "Contract Signed."
• Real-Time Data Aggregation: Synced custom dashboard reporting cards that automatically update numbers when backend Make.com or API automations trigger.
• Executive Performance Reports: Set up high-level summary charts showing total active deal values, conversion rates, and pipeline health at a single glance.
The Result: Full pipeline visibility for management, zero lost deal tracking, and an organized sales team that knows exactly which customer to follow up with next.
AI-Powered Document API (RAG) — deployed on Render
FastAPI, PostgreSQL, OpenAI API, React, Docker, GitHub Actions
• Built a RAG backend: PDF ingestion, overlapping chunking, embedding-based retrieval, and OpenAI answers grounded in retrieved chunks, behind JWT auth with response caching.
• Debugged a chain of Render build and runtime failures (memory limits, dependency conflicts, ephemeral disk) and replaced a local FAISS index with PostgreSQL-stored embeddings and NumPy cosine similarity.
