This was a job that required simple web scraping but a complex data management system. The script I developed was to scrape a single webpage with info on the Nippon India Mutual Fund every minute. The scraped data then needed to be stored in a CSV file in a specific format. Furthermore the certain data would also be sent as part of an email alert if a variety of conditions were met in the extracted data.
This script also needed to be hosted on an AWS EC2 instance to run 24/7. Combining setting up this instance with fleshing out the scripts error handling, and data collection meant this job required precise attention to detail in all aspects.