End-to-End ETL pipeline

Starting at

$

75

/hr

About this service

Summary

I will help to build end-to-end ETL pipelines, along with documentation, and assistance to deploy it. I will also help to write transformation logic.

What's included

  • Create Integrated ETL pipelines

    Create an end-to-end ETL or ELT pipeline(s) with any data source: Database, API, or files, perform transformations with pandas, or pyspark, and load it to any datawarehouse. Schedule it with any orchestration tool like airflow, or cron job.

  • Create transformation logic

    Create transformation logic in spark, pandas or dbt. Create transformation functions in Snowflake.


Skills and tools

Data Modelling Analyst
Data Analyst
Data Engineer
Apache Airflow
AWS
AWS Lambda
pandas
Snowflake

Industries

Data Mining
Cloud Data Services
Big Data

Work with me