What's included

• ETL Pipeline

  Build and orchestrate an ETL pipeline to extract data from one or more data sources. The ETL pipeline includes 1. Source Connectivity 2. Workflow orchestration (Airflow, Dagster) 3. Data Transformation 4. Load Data to a destination (Data warehouse)

• Data Warehouse Implementation

  I will build a data warehouse where the transformed and cleaned data resides and from where we will use the data for reporting and dashboarding Data warehousing tools like Amazon S3, Google Cloud Storage, Azure SQL, Amazon RDS and Azure DynamoDB can be utilized for data warehouse implementation

• Data Visualization

  Data visualization with 1. Matplotlib (web based, Jupyter Notebook, Google Collab) 2. Power BI 3. Tableaue The dynamic charts and visualizations can be used for reporting, decision making and training of machine learning and AI models