Foundational data engineering work with data pipelines, data lakes, and infrastructure management.
What's included
Modeling and Setting up Databases
Model and setup databases like postgres, mongodb, clickhouseDB, bigquery etc on a server for data management.
Creating Automated Data Pipelines
Create pipelines, ETLs for processing data from internal/external sources to destinations
Tools preferred but not limited to: Airflow, Airbyte, Python, GCP, Spark, GKE, Kubernetes
Setting up Business Analytics Tools and Dashboarding
Set up business analytics tools such as metabase, retool, Power BI, Tableau etc.
Foundational Data Architecture
Initial DevOps work and holistic infrastructure management with alert systems, helm, whimsical, Amundsen etc
Foundational data engineering work with data pipelines, data lakes, and infrastructure management.
What's included
Modeling and Setting up Databases
Model and setup databases like postgres, mongodb, clickhouseDB, bigquery etc on a server for data management.
Creating Automated Data Pipelines
Create pipelines, ETLs for processing data from internal/external sources to destinations
Tools preferred but not limited to: Airflow, Airbyte, Python, GCP, Spark, GKE, Kubernetes
Setting up Business Analytics Tools and Dashboarding
Set up business analytics tools such as metabase, retool, Power BI, Tableau etc.
Foundational Data Architecture
Initial DevOps work and holistic infrastructure management with alert systems, helm, whimsical, Amundsen etc