tauseefhashmi/DataEngineeringKafkaPipelineStocks by Tauseef Ahmad Hashmitauseefhashmi/DataEngineeringKafkaPipelineStocks by Tauseef Ahmad Hashmi

tauseefhashmi/DataEngineeringKafkaPipelineStocks

Tauseef Ahmad Hashmi

Data Scraper

Data Visualizer

Data Engineer

Kafka

Python

SQL

DataEngineeringKafkaPipelineStocks This is Apache Kafka Data Pipeline which takes in the stock data from Alphavanatage Web Api and fetches the data into the MySQL Database.

You first need to install Kafak into your system and run the following commands. STEP 1: To Start Zookeeper C:\kafka\bin\windows>zookeeper-server-start.bat C:\kafka\config\zookeeper.properties

STEP 2:To start Kafka Broker C:\kafka>.\bin\windows\kafka-server-start.bat C:kafka\config\server.properties

Step 3:To Create topic C:\kafka\bin\windows>kafka-topics.bat --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

STep 4:Start Producer C:\kafka\bin\windows>kafka-console-producer.bat --broker-list localhost:9092 --topic DE9

To create consumer C:\kafka-2.12\bin\windows>kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic DE9 --from-beginning

Like this project

Posted Nov 2, 2023

Contribute to tauseefhashmi/DataEngineeringKafkaPipelineStocks development by creating an account on GitHub.

Likes

Views

Tags

Data Scraper

Data Visualizer

Data Engineer

Kafka

Python

SQL

Featured on

Best Hindi-speaking SQL freelancers to hire in 2026 Best Hindi-speaking freelance Data Scrapers to hire in 2026 Best German-speaking freelance Data Visualizers to hire in 2026

Tauseef Ahmad Hashmi

Creative Data Wizard

tauseefhashmi/DataEngineeringPipeline

tauseefhashmi/TrafficSignDetectSimpleApp

Dashboards