Data Engineering and Infrastructure

Contact for pricing

About this service

Summary

Foundational data engineering work with data pipelines, data lakes, and infrastructure management.

What's included

  • Modeling and Setting up Databases

    Model and setup databases like postgres, mongodb, clickhouseDB, bigquery etc on a server for data management.

  • Creating Automated Data Pipelines

    Create pipelines, ETLs for processing data from internal/external sources to destinations Tools preferred but not limited to: Airflow, Airbyte, Python, GCP, Spark, GKE, Kubernetes

  • Setting up Business Analytics Tools and Dashboarding

    Set up business analytics tools such as metabase, retool, Power BI, Tableau etc.

  • Foundational Data Architecture

    Initial DevOps work and holistic infrastructure management with alert systems, helm, whimsical, Amundsen etc


Skills and tools

Data Engineer
Data Scraper
AWS
Google Cloud Platform
Python
SQL

Work with me