Developed a robust data scraping solution using Python, Selenium, and undetected Chrome drivers to extract 87,000 broker profile pages of NSE. Implemented multi-threading and optimized the scraping logic to achieve a 12x speed improvement, completing a task estimated at 150 hours in just 12 hours.
Like this project
0
Posted Dec 20, 2024
Scraped 87k NSE broker profiles (Selenium, undetected Chrome, multi-threading). Reduced scraping time from 150h to 12h.