STEP 1: DOWNLOAD KAFKA
Download and Setup Kafka on Windows and Linux
Kafka is a distributed streaming platform that allows you to publish and subscribe to streams of records. In this guide, we will provide links to download and set up Kafka on both Windows and Linux operating systems.
Download Kafka
Windows
You can download the latest version of Kafka for Windows from the Apache Kafka website.
Linux
To download Kafka on Linux, open a terminal and run the following command:
This command will download the latest version of Kafka available at the time of writing this guide.
Set Up Kafka
Once you have downloaded the Kafka binaries, follow the steps below to set up Kafka on your system.
Windows
Extract the Kafka archive you downloaded to a directory of your choice
Navigate to the Kafka directory and open the
config folder. Edit the
zookeeper.properties file and replace the dataDir property with a directory path where you want to store ZooKeeper data.Start ZooKeeper by running the following command from the Kafka directory: bin\windows\zookeeper-server-start.bat config\zookeeper.properties
Open a new command prompt window and navigate to the Kafka directory.
Edit the
server.properties file and replace the log.dirs property with a directory path where you want to store Kafka logs.Start Kafka by running the following command from the Kafka directory: bin\windows\kafka-server-start.bat config\server.properties
Linux
Extract the Kafka archive you downloaded to a directory of your choice.
Navigate to the Kafka directory and open the
config folder.Edit the
zookeeper.properties file and replace the dataDir property with a directory path where you want to store ZooKeeper data.Start ZooKeeper by running the following command from the Kafka directory:bin/zookeeper-server-start.sh config/zookeeper.properties
Open a new terminal window and navigate to the Kafka directory.
Edit the
server.properties file and replace the log.dirs property with a directory path where you want to store Kafka logs.Start Kafka by running the following command from the Kafka directory:bin/kafka-server-start.sh config/server.properties
STEP 2 : Running python script
Run kafka server
pip install -r requirements.txt
How to use producer
go to terminal where the python code producer.py is and type
python producer.pyHow to use consumer (producer must be running in order to use this command)
Use consumer to run stream of fake heart data
go to terminal where the consumer.py is and type
python consumer.py streamUse consumer to create dataset of fake heart data (dataset.json must be present in order to run this command)
(dataset.json is automatically formed when running stream using
python consumer.py stream command)go to terminal where the consumer.py is and type
python consumer.py dataset0 likes · 10 views · Jul 1, 2023
Fake-Heart-Sensor-Data-Using-Python-and-Kafka is a GitHub project that provides a simple and easy-to-use way to generate simulated heart sensor data using Pyth…
