PriceRipper - Price Comparison Website

The PriceRipper is a comprehensive platform designed to help users find the best deals on electronics by comparing prices from various top Australian eCommerce sites. Built using a combination of modern web development and data scraping technologies and AI, this project offers a robust solution for price comparison across multiple categories of electronics.

Frontend: Next JS

Backend: Flask

Database: PostgreSQL

Scraping Tools: Python, Selenium, BeautifulSoup

Data Sources: TheGoodGuys, Betta, JB-HiFi, eBay, Amazon, and other major Australian eCommerce sites

Utilised Python with Selenium and BeautifulSoup to scrape data from leading Australian eCommerce sites.

Gathered comprehensive information on various electronics, including prices, specifications, and availability.

Compiled and processed the scraped data to create detailed price comparison lists across multiple electronics categories using a name mapping algorithm since every product is listed with a different name on different website.

Enabled users to quickly and easily compare prices from different retailers to find the best deals.

While the project did not have a dedicated UI/UX designer, the user interface was influenced by Pricerunner.com (formerly pricerunner.co.uk).

Focused on a clean and intuitive layout to ensure ease of use for visitors.

Defined project goals and identified key eCommerce sites for data scraping.

Outlined the scope and functionality of the price comparison features.

Developed web scraping scripts using Python, Selenium, and BeautifulSoup to extract data from targeted eCommerce sites.

Ensured data accuracy and handled challenges related to dynamic content and anti-scraping measures.

Built the backend using Flask to handle data processing and serve the scraped information.

Designed and implemented a PostgreSQL database to store and manage the collected data.

Developed the frontend using Next JS, creating a responsive and user-friendly interface.

Integrated the backend APIs to display real-time price comparisons to users.

Conducted thorough testing to ensure the reliability and performance of the data scraping and comparison functionalities.

Optimised the scraping scripts and backend processes for efficiency.

Deployed the application, ensuring it was scalable and secure.

Monitored the platform to maintain data accuracy and performance.

The Price Comparison Website successfully launched, providing users with a valuable tool for finding the best deals on electronics. The platform's ability to scrape and compare prices from multiple major retailers in real-time helped users make informed purchasing decisions, ultimately enhancing their shopping experience.

This project showcased the effective use of web scraping and modern web development technologies to deliver a practical and user-friendly solution for price comparison.