Orases | Automated ETL Pipeline for Data Processings

Orases, a leading software development company, is seeking an experienced ETL Developer to build a fully automated data pipeline using Apache Airflow, AWS S3, AWS Glue, and Amazon Athena. The goal is to streamline data ingestion, transformation, and analysis, enabling real-time insights and reducing manual data processing efforts.

✅ Extracts data from an API source and ingests it into a processing system. ✅ Processes & Transforms data using Apache Airflow and stores it in PostgreSQL. ✅ Loads & Stores processed data into Amazon S3 for scalability. ✅ Structures & Catalogs data with AWS Glue Crawler and maintains metadata in AWS Glue Data Catalog. ✅ Enables Querying & Analysis using Amazon Athena to facilitate business insights.

🔹 Apache Airflow 🔹 PostgreSQL 🔹 Amazon S3 🔹 AWS Glue 🔹 Amazon Athena

✅ Automated Data Processing: Eliminated the need for manual log collection. ✅ Scalability: AWS services handled large-scale log data with minimal overhead. ✅ Cost Optimization: Serverless processing reduced database maintenance costs. ✅ Data-Driven Decisions: Allowed real-time monitoring of user engagement patterns.