Data pipelines, scrapers & dashboards: clean data on a schedule by Jonathan VData pipelines, scrapers & dashboards: clean data on a schedule by Jonathan V
Data pipelines, scrapers & dashboards: clean data on a scheduleJonathan V
Cover image for Data pipelines, scrapers & dashboards: clean data on a schedule
Your numbers live in five places: APIs, websites, spreadsheets, exports. Someone pulls them together by hand every week and the report is out of date the day it lands. I build the pipeline that does it for you, on a schedule.
What I build
Collectors for APIs, public websites and file drops, at a polite rate and within each site's terms
Cleaning, deduplication and one consistent schema
A warehouse that fits the size: Postgres, DuckDB or Cloudflare (D1, R2, KV)
Scheduled runs with alerts when a source changes or breaks
A dashboard or a weekly CSV/Sheets export your team already knows how to use
How it works
Tell me the sources and the question you want answered. You get a fixed price, then a pipeline that runs on its own, with tests and a short handover.
Recent builds
A pipeline over Google's EU ad transparency archive, an hourly data lake and autopilot on Cloudflare Workers, and code scanners that map legacy API usage across a codebase.
Starting at$400
Duration1 week
Tags
Python
Service provided by
Jonathan V Oslo, Norway
Data pipelines, scrapers & dashboards: clean data on a scheduleJonathan V
Starting at$400
Duration1 week
Tags
Python
Cover image for Data pipelines, scrapers & dashboards: clean data on a schedule
Your numbers live in five places: APIs, websites, spreadsheets, exports. Someone pulls them together by hand every week and the report is out of date the day it lands. I build the pipeline that does it for you, on a schedule.
What I build
Collectors for APIs, public websites and file drops, at a polite rate and within each site's terms
Cleaning, deduplication and one consistent schema
A warehouse that fits the size: Postgres, DuckDB or Cloudflare (D1, R2, KV)
Scheduled runs with alerts when a source changes or breaks
A dashboard or a weekly CSV/Sheets export your team already knows how to use
How it works
Tell me the sources and the question you want answered. You get a fixed price, then a pipeline that runs on its own, with tests and a short handover.
Recent builds
A pipeline over Google's EU ad transparency archive, an hourly data lake and autopilot on Cloudflare Workers, and code scanners that map legacy API usage across a codebase.
$400