Live Cryptocurrency REST API &
Live Cryptocurrency REST API & Containerized PostgreSQL Ingestion Pipeline
Role: Data Engineer / Backend Developer
Tools Used: Python, PostgreSQL, Docker, Pandas, SQLAlchemy, REST APIs
Project Overview:
Designed and deployed a production-ready Python data pipeline that ingests live market data from the CoinGecko REST API and loads structured records into a containerized PostgreSQL database.
Key Architecture & Execution Steps:
1. Extraction: Fetched real-time price and volume data using Python's requests library.
2. Transformation: Cleaned and formatted raw JSON payloads into structured Pandas DataFrames, adding automated ingestion timestamps.
3. Containerized Database Setup: Configured a local PostgreSQL database running inside a Docker container via Docker Compose.
4. Modern Database Connection: Connected Python directly to PostgreSQL using SQLAlchemy and the modern psycopg (v3) driver.
5. Security: Managed secrets securely using environment variables (.env).
0 likes · 0 views · Oct 23, 2026
Live Cryptocurrency REST API & Containerized PostgreSQL Ingestion Pipeline Role: Data Engineer / Backend Developer Tools Used: Python, PostgreSQL, Docker, Pa...
