Data Engineering Projects in KarachiData Engineering Projects in KarachiA full-stack construction management platform built for an industrial contractor to replace fragmented spreadsheet-based workflows with one centralized production system.
Built a T&M estimating system with crew-based labor and cost/billable rate calculations, GPS-verified field time tracking, per-diem and cost-code allocation, purchase order and commitment tracking, cost reporting, payroll processing, client-facing billing views, and invoicing.
The platform includes 28 modules, 9 permission roles, REST APIs, and print-ready PDF/Excel exports, and was shipped iteratively while being used in daily production.
Stack: Laravel 12 · PHP 8.3 · MySQL · Alpine.js · Tailwind CSS · REST API Problem:
Financial data from stocks and crypto APIs was scattered, refreshed manually, and not ready for analytics or ML use.
Solution:
Built an Apache Airflow pipeline to collect, transform, validate, and load real-time financial data from multiple APIs into PostgreSQL, MongoDB, AWS RDS, and Qdrant.
Tools:
Apache Airflow, Python, PostgreSQL, MongoDB, AWS RDS, Qdrant, APIs
Result:
Automated sub-hourly data refresh, processed thousands of records daily, and delivered clean data for dashboards, analytics, and vector search. Meeting Consultancy Platform.
Built a real-time meeting and consultancy platform that connects clients with consultants through live communication, scheduling, and session management.
The platform allows users to discover consultants, book consultation sessions, manage appointments, join live meetings, send messages, and track session activity from a clean dashboard.
A WebSocket-based communication layer was used to support real-time updates, chat activity, meeting status, notifications, and smoother interaction between users and consultants.
The goal was to create a reliable consultation system where service providers can manage their availability and clients can easily book, communicate, and attend sessions in one place.