Data Engineering and Infrastructure

Contact for pricing

About this service

Summary

Foundational data engineering work with data pipelines, data lakes, and infrastructure management.

What's included

  • Modeling and Setting up Databases

    Model and setup databases like postgres, mongodb, clickhouseDB, bigquery etc on a server for data management.

  • Creating Automated Data Pipelines

    Create pipelines, ETLs for processing data from internal/external sources to destinations Tools preferred but not limited to: Airflow, Airbyte, Python, GCP, Spark, GKE, Kubernetes

  • Setting up Business Analytics Tools and Dashboarding

    Set up business analytics tools such as metabase, retool, Power BI, Tableau etc.

  • Foundational Data Architecture

    Initial DevOps work and holistic infrastructure management with alert systems, helm, whimsical, Amundsen etc


Skills and tools

Data Engineer

Data Scraper

AWS

Google Cloud Platform

Python

SQL