Large-Scale NSE Broker Profile Scraping (87,000 Profiles)
Om Singh Chandel
Developed a robust data scraping solution using Python, Selenium, and undetected Chrome drivers to extract 87,000 broker profile pages of NSE. Implemented multi-threading and optimized the scraping logic to achieve a 12x speed improvement, completing a task estimated at 150 hours in just 12 hours.
Like this project
Posted Dec 20, 2024
Scraped 87k NSE broker profiles (Selenium, undetected Chrome, multi-threading). Reduced scraping time from 150h to 12h.
Likes
0
Views
1
