EasyGIC Rates Scraper

Faiz Shahid

Description

The EasyGIC Rates Scraper is a robust web scraping solution developed using Selenium in JavaScript. This project aims to extract and store up-to-date GIC rates from various banks' web pages into a database. The scraper automates the data collection process and ensures the information remains current by running nightly through a cron job. The data is then displayed on a WordPress site using custom HTML and JavaScript scripts.

Role & Responsibilites

In this project, I was responsible for developing the entire solution, starting with writing the web scraper using Selenium in JavaScript. The scraper was designed to extract GIC rates from various bank websites. Once the scraper completed its nightly run, it generated a report and automatically sent it via email. Additionally, I developed a Node.js Express server, creating APIs that the frontend could consume to display the scraped data. I also handled the WordPress integration, writing custom HTML and JavaScript scripts to seamlessly display the rates on the site. Finally, I was responsible for deploying the entire solution, including configuring the server with a custom domain to ensure a professional and accessible web presence.
Like this project
0

Posted Jul 28, 2024

The EasyGIC Rates Scraper, built with Selenium in JavaScript, extracts GIC rates & stored in database. It displays data on a WordPress site using custom JS.

Educational Portal
Educational Portal
Assessment Management Platform
Assessment Management Platform
Recruitment Portal
Recruitment Portal