A comprehensive Scrapy project for scraping eBay product data with advanced features including pagination, multiple categories, and robust data processing.
Features
Multiple Categories: Electronics, Clothing, Home & Garden, Sports, Books
Pagination Support: Automatically handles multiple pages of results
Data Validation: Validates and cleans scraped data
Duplicate Removal: Prevents duplicate entries
Multiple Export Formats: JSON and CSV
Robust Error Handling: Handles various page layouts and missing data
Rate Limiting: Respectful scraping with delays and throttling