Real-Time Analytics Platform on AWS

Real-Time Analytics Platform on AWS designed to ingest, process, and visualize high-volume streaming data from IoT devices and application logs.

Ingestion: Device telemetry (IoT Core) and application logs are published into Amazon Kinesis Data Streams, followed by lightweight routing and enrichment using AWS Lambda.

Processing & Storage: Amazon EMR performs heavy data transformations via Spark Structured Streaming, landing the curated output into Amazon S3 as partitioned Parquet files. AWS Glue then handles batch transformations before loading the data into Amazon Redshift for the analytics workload.

Orchestration & Serving: AWS Step Functions coordinate the batch processing workflows. Finally, Amazon QuickSight generates actionable business dashboards while Amazon CloudWatch monitors operational metrics and alarms