What's included

• Automated Data Pipelines

  I will set up pipelines that gather data from APIs or external systems into a data lake (Azure or AWS Storage), loads relevant data into a warehouse staging layer (Azure SQL or Snowflake), and performs transformations and analytics to create production-ready tables and views in the warehouse. Pipelines will be written in SQL and Python and automated using workflow solutions such as Azure Data Factory. The pipelines will be automated to refresh on a schedule as required by the business.

• Data Warehouse

  Using best practices, I will develop a data model based on understanding the business requirements that can support user queries and upon which views can be created for consumption in reports. The infrastructure and schemas will be created through code. I will work within existing database systems and cloud accounts or create new secure environments as needed.