Scooper is an Electron-based web-scraping and data collection workspace that captures raw e-commerce data, monitors runs with real-time logs, transforms results into interactive dashboards, and exports for further analysis. It integrates tightly with AWS for auth, persistence, and LLM-powered enrichment, enabling reliable, cross-platform data operations.
Main Goal
The main goal of SCOOPER is to make large-scale product data collection effortless and trustworthy. It automates browser actions, parses pages safely, handles anti-bot stealth, structures results for charts and geo-views, and supports export—so teams can move from messy pages to clean, analysis-ready datasets with minimal friction
Project Implementation
We built Scooper as a hybrid desktop + cloud pipeline: Playwright drives headless browsing while Cheerio parses HTML; a normalization layer maps fields and attaches run metadata. Electron (React + TypeScript) streams real-time performance logs to the UI; ECharts and MapLibre power KPI and geo-dashboards. AWS Cognito secures access; API Gateway + Lambda handle ingestion and transformations; S3 stores artifacts; Bedrock enables AI extraction and schema assistance; Amplify manages configuration. Cross-platform packaging ships a consistent runtime for Windows and macOS.
Stealth Mode
Features
Playwright + Cheerio Integration
AWS Integration (Cognito, API Gateway, Lambda, S3, Bedrock)
Multi-OS Support
AI/LLM Support
Real-time Performance Logging
Geo-dashboards using MapLibre
Scraping Stealth Mode
Geo Dashboard
Skills:
Electron, React, TypeScript, Webpack, ECharts, MapLibre, Playwright, Cheerio, AWS Amplify, AWS Cognito, AWS Lambda, API Gateway, S3. Additional expertise across testing, CI/CD, and data visualization from prior full-stack work (React, FastAPI, AWS).
Like this project
Posted Oct 15, 2025
Developed Scooper, an Electron-based tool for e-commerce data collection and analysis.