Data Ingestion
As part of this project i worked on a gathering data from city council about general public transport and upon gathering created a spark job that gets data from api in real-time and dumps in to database for later usage.
Like this project
0
Posted Jan 9, 2024
Led ETL pipeline development, seamlessly integrating API data into a database for real-time access—optimizing workflow efficiency
Likes
0
Views
3
Automated Logging and Monitoring System
Analysis and Forecast