The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
A scraper that "works on my machine" but 403s in production? Check your User-Agent before anything else.
Python's default urllib User-Agent gets blocked by a huge number of sites instantly. The fix is one line — send a real browser User-Agent — but the failure looks like a hundred other things (auth, rate-limits, IP bans), so people chase the wrong bug for an hour.
The broader lesson from building scrapers daily: the code is easy, the resilience is the job — pagination, rate-limits, anti-bot headers, retries. That's where the value is.
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Related posts
Very nice
My first biggest project was developing a Framer website for https://libertinelondon.com
Charged $2.5k for development
they provided the design
congrats
Heres a project is will soon be starting i wanted to share the web design showcase.
The oversized type and the can bursting out of the peach make this pop. Strong first screen. One small idea: "click now" could say what happens next, like "Shop the 6-pack" or "Find it near you", since a specific action tends to get more clicks than a generic one. If the build...
