ETL-Discovery-AI-tool by Pankaj KumarETL-Discovery-AI-tool by Pankaj Kumar

ETL-Discovery-AI-tool

Pankaj Kumar

Backend Engineer

Fullstack Engineer

Web Developer

Flask

Python

Streamlit

Data

ETL-Discovery-AI-tool

The Open-Source Generic ETL Tool is the core engine for Extract, Transform, and Load (ETL) operations. It is designed to handle data extraction, transformation, and loading tasks efficiently. It will be used to train the OpenAI model on the ETL Discovery tools.

Step 2. How to set up and run

* Clone the Repository/ download the file
* UNZIP the sources or clone the private repository. After getting the code, open the file in the vs code, take a new terminal, and navigate to the working directory.
* Setup Environment
* virtualenv modules installation (Windows-based systems)
* Python –m venv  .venv-  Name your venv according to you
* .venv\Scripts\activate- for activating the env
* Install the Required Application 
* pip install -r requirements.txt
* Create a .env file for storing the OpenAI API key

Run

* -Run assistant_creator.py file
* Python assistant_creator.py
* - Run app1.py file
* Python app1.py
* - Run the main.py file
* Streamlit run main.py

Like this project

Posted Feb 13, 2025

The Open-Source Generic ETL Tool serves as the core engine for Extract, Transform, and Load (ETL) operations. It is designed to handle data extraction, transfo…

Likes

Views

Clients