Gold COT Data Scraper & Dashboard

Yoseph

Yoseph Zemede

Automated Gold COT Data Scraper & Interactive Streamlit Dashboard

I built a Python project that collects and organizes weekly gold market data (Commitments of Traders reports) from the CFTC Website. I created it for my brother because he is a forex trader. The script uses requests, BeautifulSoup, and pandas to automatically download data from 2019 to 2025, clean it, and save it into an Excel file for easy use.
After that, I built a Streamlit dashboard that shows the data in interactive graphs. The dashboard allowed my brother to explore trends in gold futures positioning across time.
Key features:
Automated extraction of 7 years of weekly gold COT reports
Robust HTML parsing with error handling for consistency
Data cleaning and structuring using pandas
Export to Excel for further analysis
Interactive Streamlit dashboard with dynamic plotting
Saves significant manual effort and accelerates trading decision-making
Like this project

Posted Sep 23, 2025

Developed a Python-based gold market data scraper and Streamlit dashboard.