Extraction of 1.39M+ Records by Juan Gajardo Extraction of 1.39M+ Records by Juan Gajardo

Extraction of 1.39M+ Records

Juan Gajardo

Juan Gajardo

One of the biggest projects I've worked so far.
The job consisted in scraping 1.39M+ physician CV profiles from Doximity, the largest professional medical network in the U.S.
There were no shortage of challenges including managing a large-scale dataset while ensuring data integrity, configure rate limits and proper IP rotation.
Like this project

Posted Jan 30, 2025

One of the biggest projects I've worked so far, 1.39M+ physician CVs from Doximity, the largest professional medical network in the U.S.