Data Engineering Projects in KarachiData Engineering Projects in KarachiA full-stack construction management platform built for an industrial contractor to replace fragmented spreadsheet-based workflows with one centralized production system.
Built a T&M estimating system with crew-based labor and cost/billable rate calculations, GPS-verified field time tracking, per-diem and cost-code allocation, purchase order and commitment tracking, cost reporting, payroll processing, client-facing billing views, and invoicing.
The platform includes 28 modules, 9 permission roles, REST APIs, and print-ready PDF/Excel exports, and was shipped iteratively while being used in daily production.
Stack: Laravel 12 · PHP 8.3 · MySQL · Alpine.js · Tailwind CSS · REST API Problem:
Financial data from stocks and crypto APIs was scattered, refreshed manually, and not ready for analytics or ML use.
Solution:
Built an Apache Airflow pipeline to collect, transform, validate, and load real-time financial data from multiple APIs into PostgreSQL, MongoDB, AWS RDS, and Qdrant.
Tools:
Apache Airflow, Python, PostgreSQL, MongoDB, AWS RDS, Qdrant, APIs
Result:
Automated sub-hourly data refresh, processed thousands of records daily, and delivered clean data for dashboards, analytics, and vector search.