Freelancers using Apache AirflowFreelancers using Apache Airflow* Delivered on a number of projects within the Service Product Line, projects including:
* Rider Customer Chat
* Customer Agent Chat
* Fraud detection (Exploit)
* Event Tracking system (internal solution for tracking)
* First analyst within projects, set up from scratch all of the tracking, AB Testing and setting up an analytics mentality, North star metrics, monitoring and troubleshooting
* Led cross functional discussions among Analysts, Engineers, Product managers and Operations analysts, which moved the needle further.
* Brought in a more collaborative mentality among analysts, and set up weekly sharing sessions, as well as informal follow ups. This in the end created more trust, a happier team and better quality of deliverables for stakeholders. Problem:
Many organizations still process invoices manually by reading PDF documents and entering key details (invoice number, vendor, amount, etc.) into systems. This process is slow, error-prone, and difficult to scale, and it also makes it harder to detect duplicate invoices or incorrect totals.
Solution:
This project builds an automated invoice processing pipeline that converts uploaded invoice PDFs into structured data. It uses OCR to extract text, LLMs to identify invoice fields, validation checks to ensure correctness, and Kafka-based event streaming to manage the processing pipeline. The extracted data is stored in PostgreSQL and visualized through a dashboard, enabling faster, scalable, and more reliable invoice processing. Problem:
Financial data from stocks and crypto APIs was scattered, refreshed manually, and not ready for analytics or ML use.
Solution:
Built an Apache Airflow pipeline to collect, transform, validate, and load real-time financial data from multiple APIs into PostgreSQL, MongoDB, AWS RDS, and Qdrant.
Tools:
Apache Airflow, Python, PostgreSQL, MongoDB, AWS RDS, Qdrant, APIs
Result:
Automated sub-hourly data refresh, processed thousands of records daily, and delivered clean data for dashboards, analytics, and vector search.