The job consisted in scraping 1.39M+ physician CV profiles from Doximity, the largest professional medical network in the U.S.
There were no shortage of challenges including managing a large-scale dataset while ensuring data integrity, configure rate limits and proper IP rotation.
Like this project
Posted Jan 30, 2025
One of the biggest projects I've worked so far, 1.39M+ physician CVs from Doximity, the largest professional medical network in the U.S.