Data Engineer | GCP | BigQueryt

Starting at

$

30

/hr

About this service

Summary

As a Data Engineer specializing in GCP, BigQuery, Dataflow, Pub/Sub, and Snowflake, I offer end-to-end data solutions that streamline data ingestion, transformation, and analytics. What makes me unique is my ability to design scalable architectures that ensure data quality and accessibility while leveraging real-time processing capabilities for immediate insights. With a strong focus on collaboration and tailored solutions, I empower organizations to harness the full potential of their data in a cloud environment.

What's included

  • Scalable Data Warehouse Architecture

    Build and configure a high-performance, scalable data warehouse using BigQuery or Snowflake to enable efficient data storage, management, and querying at scale.

  • Real-Time Data Streaming Solution

    Set up and configure real-time data streaming using GCP Pub/Sub and Dataflow, enabling your business to process and analyze data as it arrives for instant insights and decision-making.

  • Cloud Data Migration Strategy

    Create a detailed migration plan to move your legacy systems' data to GCP, ensuring minimal downtime, data integrity, and seamless integration with your new cloud infrastructure.

  • Data Transformation and ETL Automation

    Develop ETL processes to extract, transform, and load data using GCP Dataflow, ensuring high-quality, clean data is available for analytics, reporting, and machine learning.

  • Custom Reporting and Analytics Pipeline

    Build a custom reporting and analytics pipeline that integrates with BigQuery or Snowflake, allowing stakeholders to easily query data and generate business insights with minimal effort.

  • Real-Time Event-Driven Architecture

    Design and implement an event-driven architecture using GCP Pub/Sub to facilitate real-time event processing, enabling responsive business actions based on live data streams.


Skills and tools

Data Scientist
Data Analyst
Data Engineer
Data Analysis
Google Cloud Platform
MATLAB
Microsoft Excel
pandas

Industries

Analytics
Data Center Automation
Warehouse Automation

Work with me