Freelancers using AWS EMR in LahoreFreelancers using AWS EMR in Lahore
ProjectsPeople
Advancing Data Solutions's avatar
Advancing Data Solutions
proLahore, Pakistan
AI & Data Engineer|Data & AI Architect| AWS|Azure |Snowflake
AI & Data Engineer|Data & AI Architect| AWS|Azure |Snowflake
Cover image for Real-Time Analytics Platform on AWS
Real-Time Analytics Platform on AWS designed to ingest, process, and visualize high-volume streaming data from IoT devices and application logs. Ingestion: Device telemetry (IoT Core) and application logs are published into Amazon Kinesis Data Streams, followed by lightweight routing and enrichment using AWS Lambda. Processing & Storage: Amazon EMR performs heavy data transformations via Spark Structured Streaming, landing the curated output into Amazon S3 as partitioned Parquet files. AWS Glue then handles batch transformations before loading the data into Amazon Redshift for the analytics workload. Orchestration & Serving: AWS Step Functions coordinate the batch processing workflows. Finally, Amazon QuickSight generates actionable business dashboards while Amazon CloudWatch monitors operational metrics and alarms
0
254
Cover image for Real-Time Analytics Platform on AWS
Real-Time Analytics Platform on AWS
0
7
Cover image for Oracle to Amazon RDS PostgreSQL Designed
Oracle to Amazon RDS PostgreSQL Designed and Implemented a secure, scalable architecture to migrate an on-prem Oracle database to Amazon RDS for PostgreSQL. Data Flow: Modeled end-to-end flow, used AWS Glue (SCT) for schema conversion and DMS for full-load and CDC. Stored artifacts in S3 and loaded into RDS. Services: Glue for conversion, DMS for Migration , S3 for artifacts, and RDS as target. Security: IAM roles with least privilege, KMS for encryption at rest. HA & DR: Architected in us-east-1 with Glue, DMS, RDS, S3, and monitoring via CloudWatch.
0
207
Cover image for OnPrem .NET to AWS Migration Migrated
OnPrem .NET to AWS Migration Migrated an on‐premises .NET web application and SQL Server database to AWS to achieve scalability, high availability, and cross‐region resilience. The legacy environment ran on Windows servers with a clustered SQL Server, resulting in high maintenance and limited elasticity. The new AWS architecture features EC2 Auto Scaling behind an Application Load Balancer (ALB), Amazon RDS for SQL Server with Multi‐AZ and a cross‐region read replica, and DNS failover via Route 53. ◦ Deployed the .NET application on an EC2 Auto Scaling group (Windows AMI) across private subnets in us‐east‐1. 5- Build Scalable Real-Time Data Analytics on AWS for Instant Insights Designed and implemented a real-time data analytics platform on AWS, enabling stream processing, transformation, and visualization for high-volume IoT and log data. This system was built to process and analyze millions of records per second, providing actionable insights for business decision-making. The solution leveraged AWS native services like Kinesis, Glue, Lambda, and Redshift, integrating Apache Spark Structured Streaming to handle real-time data ingestion and transformation. Airflow and Step Functions were used for workflow automation.
0
244
AWS EMR(1)