Data Engineering

Starting at

$

30

/hr

About this service

Summary

Experienced Data Engineer with 5 years of expertise in designing, developing, and deploying scalable data solutions across cloud platforms. Led the architecture, migration, and deployment of comprehensive data migration projects from GCP to Databricks, including converting Airflow DAGs to optimized Databricks workflows. Skilled in Python, PySpark, and SQL for advanced data transformation, integration, and migration, including moving on-premises SQL databases and multiple third-party API data sources to Azure Data Lake, Azure SQL Database, and Azure Data Warehouse. Proficient in developing Spark applications within Databricks to perform ETL tasks such as data extraction, transformation, and aggregation from diverse file formats, uncovering insights into customer usage patterns. Experienced in end-to-end SQL Server database design and development, as well as business intelligence (BI) workflows. Expertise spans project lifecycle phases, including solution design, implementation, and automation using SQL scripts, ADF pipelines, data flows, Power Automate flows, and Azure Key Vault integrations. Known for strong analytical and problem-solving skills, effective communication, and a collaborative approach to driving impactful data engineering solutions.

What's included

  • Project Requiremrnts as discussed and established.

    I am committed to delivering this future project exactly as per the established requirements. My approach will be fully aligned with your objectives, ensuring a tailored solution that meets all expectations and delivers measurable value.


Skills and tools

Data Analyst

Data Engineer

Software Engineer

Databricks

PySpark

PySpark

Python

Python

Snowflake

Snowflake

SQL

SQL

Industries

IT Infrastructure