Using Confluent Kafka, I've set up a smooth pipeline for streaming bidding data directly from my Python Flask website. Through the utilization of parallel consumer processes, I efficiently fetch and store this data into a MySQL database. For insightful visualization, I've developed a comprehensive dashboard using the Power BI tool. Additionally, I've chosen to host my MySQL database on
aiven.io for seamless accessibility and management.