Custom Data Pipelines with Python and Cloud
Subrin Al Azad
5
Contact for pricing
About this service
Summary
What's included
I will develop the followings
I will do the following in this process:- ○ Data Extraction: Efficiently extract data from specified APIs and other data sources. ○ Data Transformation: Cleanse, validate, and transform data into a usable format. ○ Data Loading: Load transformed data into the desired cloud data warehouse (e.g., BigQuery). ○ Data Pipeline Development: Build robust and scalable Python-based data pipelines. ○ Documentation: Provide clear and concise documentation of the developed pipeline. Additional Deliverables (based on client needs): ○ Data Modeling: Create optimized data models within the data warehouse. ○ Data Visualization: Develop custom dashboards or reports using visualization tools (e.g., Looker Studio, Power BI). ○ API Development: Create custom APIs for data access and integration. ○ Data Quality Assessment: Implement data quality checks and monitoring. ○ Cloud Infrastructure Setup: Configure cloud resources (e.g., cloud storage, compute instances) for optimal pipeline performance.
Example projects
Recommendations
(5.0)
Recommended
I found him to be professional and meticulous he is hard working, dedicated, capable I found his conduct to be well-behaved and courteous, he puts the need of the customer first he is an expert in data analysis, python programming and photo retouching
Skills and tools
Work with me