Python Web Scraping: Boat Marketplace Make & Model Database by Muhammad Jahanzaib TahirPython Web Scraping: Boat Marketplace Make & Model Database by Muhammad Jahanzaib Tahir

Python Web Scraping: Boat Marketplace Make & Model Database

Portfolio project
Muhammad Jahanzaib Tahir
A Python web scraping and data extraction project that built a complete, clean database of every boat make and model listed on Boats and Outboards (boatsandoutboards.co.uk), part of Boats Group, one of Europe’s largest boat marketplace networks. I built a fast, reliable web scraper that pulls structured listing data straight from the marketplace’s API.

Web Scraping Challenge

The client needed an accurate list of boat makes and models for a listings platform, valuation tool and search filters. No public dataset exists. The data was spread across thousands of live marketplace listings, in many spelling variations, behind Cloudflare anti-bot protection.

My Web Scraping Approach

API scraping instead of HTML scraping: I reverse-engineered the marketplace’s search API to get clean JSON data with 21 search filters.
Automatic make discovery: pulled the full list of boat makes, with listing counts, from the API’s facets.
One request per make: the page size is set to each make’s listing count, so the scraper gets a make’s full inventory in one call, with no pagination.
Avoiding blocks: rotated user agents, used polite request delays, handled Cloudflare and retried failed requests automatically.
Resumable scraping: a queue of unfinished makes plus a failure log means the scraper can stop and restart without losing progress.
Data cleaning: deduplicated models per make into a structured JSON database.
# Python web scraper: one API request per make (page size = listing count)
for make, count in pending_makes():
records = search_api(make=make, page_size=count) # full inventory, no pagination
if not records:
log_failed(make)
continue

models = {r["model"] for r in records if "model" in r}
catalogue.append({"make": make, "models": sorted(models)})
mark_done(make) # resumable scraping queue

Scraped Data Delivered

A boat make → model database in clean JSON
Listing data: year, length, location, price, dealer, boat class, specifications and image URLs
Listing counts per make for market research and competitor analysis

Data Extraction Results

Models extracted for 99.7% of boat makes
Listings scraped from 50 countries across Europe and beyond
44 boat classes covered, from sailing yachts to RIBs
21 data filters captured: hull material, fuel type, engines, condition, price range and more
A reusable pipeline that can be re-run any time to collect new models
boatsandoutboats data scraping
boatsandoutboats data scraping

Web Scraping Tech Stack

Python · Web Scraping · API Scraping · Requests · Cloudscraper · JSON · Data Extraction · Data Cleaning

1 like · 0 views · Nov 10, 2026

Python web scraping project: scraped boat listings from Boats and Outboards via API to build a complete boat make & model database across 50 countries.

Tags