Data Engineering and Infrastructure by Sairaj Chicago

Data Engineering and Infrastructure by Sairaj ChicagoData Engineering and Infrastructure by Sairaj Chicago

Data Engineering and Infrastructure

Sairaj Chicago

Contact for pricing

About this service

Summary

Foundational data engineering work with data pipelines, data lakes, and infrastructure management.

Deliverables

Modeling and Setting up Databases

Model and setup databases like postgres, mongodb, clickhouseDB, bigquery etc on a server for data management.

Creating Automated Data Pipelines

Create pipelines, ETLs for processing data from internal/external sources to destinations Tools preferred but not limited to: Airflow, Airbyte, Python, GCP, Spark, GKE, Kubernetes

Setting up Business Analytics Tools and Dashboarding

Set up business analytics tools such as metabase, retool, Power BI, Tableau etc.

Foundational Data Architecture

Initial DevOps work and holistic infrastructure management with alert systems, helm, whimsical, Amundsen etc

What's included

Modeling and Setting up Databases
Model and setup databases like postgres, mongodb, clickhouseDB, bigquery etc on a server for data management.
Creating Automated Data Pipelines
Create pipelines, ETLs for processing data from internal/external sources to destinations Tools preferred but not limited to: Airflow, Airbyte, Python, GCP, Spark, GKE, Kubernetes
Setting up Business Analytics Tools and Dashboarding
Set up business analytics tools such as metabase, retool, Power BI, Tableau etc.
Foundational Data Architecture
Initial DevOps work and holistic infrastructure management with alert systems, helm, whimsical, Amundsen etc

Skills and tools

Data Engineer

Data Scraper

AWS

Google Cloud Platform

Python

SQL

More services

Data Analytics/Data Science

Contact for pricing