I designed and built an automated job-market intelligence platform that collects, cleans, normalizes, deduplicates, and analyzes listings from six global sources through daily data pipelines.
The latest version includes:
• Approximately 20,000 job records
• 93 passing automated tests
• 16 standardized job categories
• Improved parent/child category hierarchy
• More accurate normalization and deduplication
• Expanded filters for company, category, seniority, work mode, salary availability, source, and publication date
• Interactive market intelligence and pipeline-health monitoring
• Downloadable CSV and Excel reports
Built with Python, PostgreSQL, Pandas, Streamlit, Plotly, APIs, Playwright, and GitHub Actions.
This project demonstrates how I transform fragmented web data into reliable, searchable, and decision-ready business intelligence.
Global Job Intelligence — Updated Version
I designed and built an automated job-market intelligence platform that collects, cleans, normalizes, deduplicates,...