SSRN Scraper: 239K Research Papers Dataset (Client Project)
Tran Tien Van
Client project for an academic research client (client unnamed): paper metadata linked to author profiles and citations, collected behind SSRN's anti-bot layer.
What we built
A scraper that works behind SSRN's anti-bot layer
43 fields per paper, from downloads and abstract views to rank and citations
Papers linked to author profiles and delivered in two CSV batches
Results
239,037 papers and 198,523 authors delivered in two CSV batches
43 fields per paper
Top 10% of papers take 65% of 7.7 million downloads
What the data says
Abstract views predict downloads well (R² = 0.64)
Equal-sized subjects are not equally read: an 11x spread in median views
United States and China are 61% of top-12 author mentions
The dashboard was built by Van Data Team for its portfolio from the delivered data; the client engagement delivered the data.
Stack: Python, anti-bot-aware scraping, CSV delivery.
Full case study: vandatateam.com/portfolio
Like this project
Posted Nov 5, 2026
Client project: scraper behind SSRN's anti-bot layer delivering 239,037 papers (43 fields each) and 198,523 linked author profiles as CSV.
Likes
0
Views
0
