End-to-End ETL pipeline
Starting at
$
75
/hrAbout this service
Summary
I will help to build end-to-end ETL pipelines, along with documentation, and assistance to deploy it. I will also help to write transformation logic.
What's included
Create Integrated ETL pipelines
Create an end-to-end ETL or ELT pipeline(s) with any data source: Database, API, or files, perform transformations with pandas, or pyspark, and load it to any datawarehouse. Schedule it with any orchestration tool like airflow, or cron job.
Create transformation logic
Create transformation logic in spark, pandas or dbt. Create transformation functions in Snowflake.
Skills and tools
Data Modelling Analyst
Data Analyst
Data Engineer
Apache Airflow
AWS
AWS Lambda
pandas
Snowflake