Most scraping projects don't fail because of anti-bot walls. They fail because of bad error handling.
Built this as a portfolio demo, same logic scales to any catalog or listing site.
Retries failed requests with exponential backoff instead of giving up after one bad response. Random 0.5-1.5s delay between pages instead of hammering the server on a fixed timer. Follows pagination automatically until the last page. Exports straight to formatted Excel: headers, filters, frozen row, ready to hand off.
Full pipeline and the actual retry/parse code in the images.
What's the ugliest edge case that's broken a scraper on you? Timeouts, layout changes, or CAPTCHAs?
0
73
Pepgen Lab - Peptides research website
Developed a high-end e-commerce platform for a global client specializing in custom peptide products for research laboratories worldwide. To balance complex custom functionality with full client content management, the solution was built on WordPress using custom code, WooCommerce, and Elementor.
Key Features & Infrastructure
Complete E-Commerce Suite: Integrated secure payment processing, shipping management, automated email notifications, and real-time order tracking.
User & Content Management: Built custom product pages, dynamic blog templates, and secure client/user login portals.
Client-Centric CMS: Combined custom code with Elementor to allow the client complete, intuitive control over ongoing content and product management.
An app that matches video gamers with video games based on a psychological questioner. Includes a general game search section, user signup, login and more.