Large-Scale NSE Broker Profile Scraping (87,000 Profiles)

Om Singh Chandel

0

Data Scraper

Python

Scrapy

Selenium

Developed a robust data scraping solution using Python, Selenium, and undetected Chrome drivers to extract 87,000 broker profile pages of NSE. Implemented multi-threading and optimized the scraping logic to achieve a 12x speed improvement, completing a task estimated at 150 hours in just 12 hours.
Like this project
0

Posted Dec 20, 2024

Scraped 87k NSE broker profiles (Selenium, undetected Chrome, multi-threading). Reduced scraping time from 150h to 12h.

Likes

0

Views

0

Tags

Data Scraper

Python

Scrapy

Selenium

E - commerce
E - commerce
Trading App
Trading App
Forex Landing Website
Forex Landing Website