We were approached by the client to create a suite of tools that help e-commerce stores scrape data from across different online sources.

The goal of the platform is to help these stores get access to data related to their competitors, track its evolution, and make sense of it to determine what products to start selling and how to structure their ads.

The result was :

A Chrome extension that allows users to scrape data from different sources (Including Meta and TikTok)

A dashboard that helps users visualize the data, filter it, and track the evolution of the performance of their competitors' products and ads over time.

Our Front-end for both the dashboards was built mainly on SvelteKit.

The Back-end was built on NodeJs, Express, and Postgres as a Database.

The Chrome extension was also built on svelte with a custom vite adapter.

The scraping was built on puppeteer that we used along side OxyLabs' proxy network. The scraping scripts were Dockerized and deployed on GCP.