The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
Problem:
Financial data from stocks and crypto APIs was scattered, refreshed manually, and not ready for analytics or ML use.
Solution:
Built an Apache Airflow pipeline to collect, transform, validate, and load real-time financial data from multiple APIs into PostgreSQL, MongoDB, AWS RDS, and Qdrant.
Tools:
Apache Airflow, Python, PostgreSQL, MongoDB, AWS RDS, Qdrant, APIs
Result:
Automated sub-hourly data refresh, processed thousands of records daily, and delivered clean data for dashboards, analytics, and vector search.
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Related posts
Multi-source web scraper with fallback
Built an n8n CRM automation system that captures leads, creates and updates CRM records, assigns tasks, sends team notifications, automates follow-ups and generates reports.
Hi, I'm Kauê, a full stack developer from Brazil 👋
I build Python automations, web scrapers and complete web apps: REST APIs in Go and Python with React or Vue on the front end.
If you have a task someone on your team does by hand every week, there's a good chance a script can do it in minutes.
Open for new projects. Send me a message with what you need!
Great