Dynamic IT Market Analysis Platform

A fully scalable REST API using FastAPI (Python) to handle requests for in-demand IT skills and technologies across various job titles. Created Python web scraping solutions to extract and update data from numerous job market websites, ensuring real-time accuracy and relevance. Stored and organized the scraped data and statistics in a MySQL database. Utilized SerpAPI for certain tasks and built a React frontend to display the statistics.
Concepts and motivation
Market Insight: Provide valuable insights into current IT job market trends, helping job seekers, educators, and employers understand which skills and technologies are most in demand.
Automation: Reduce the manual effort required to gather and analyze job market data by automating the data extraction and update processes.
Personal Growth: Enhance my skills in backend development, database management, and data extraction, while contributing to a meaningful project that addresses real-world needs.
Technologies Used
Python
FastAPI
MySQL
Web Scraping
SerpAPI
Networking
React
Final Product
Cloud Engineer - Cloud Services

REST API docs
Generated Docs

Example of job post web scraping

Example of request response

A piece of code from a GET request

Connect with Me
Feel free to reach out if you have any questions, feedback, or just want to chat.
0 likes · 31 views · Aug 8, 2024
A scalable platform featuring a REST API using FastAPI (Python) and a ReactJS frontend, integrating data from over 100 real-world IT job market websites.