As a Data Engineer at Claro Brasil, I played the main role in optimizing data operations and developing systems that enhanced efficiency across the Rio de Janeiro headquarters. My work involved fixing the core data processing system while migrating technologies and handling high-volume datasets and ensuring seamless integration of data pipelines for key stakeholders. Key responsabilities include:
- Migrated data workflows from Microsoft Access SQL to Pandas, significantly improving processing speed and scalability. This migration enabled efficient handling and integration of data used across the entire Rio de Janeiro headquarters.
- Managed data operations for high-profile clients, including Huawei and Ericsson, ensuring data accuracy, consistency, and readiness for business-critical applications.
- Designed and developed a robust system to automate database updates and maintenance, ensuring the flexibility for future enhancements and database changes.
- Processed and analyzed data from over 20 Excel sheets, working with over 3 million records of sensitive data. Performed advanced data cleaning operations, including removing redundancies, identifying inconsistencies, and normalizing data for integration.
- Built a user-friendly graphical interface (GUI) and implemented a webdriver to automate the retrieval and processing of collaborator information, improving data accessibility and operational efficiency.
- Collaborated closely with the General Manager, providing regular updates and ensuring the alignment of data solutions with business objectives.
- Contributed to the scalability of data systems, extending the groundwork for similar operations in Minas Gerais.
Like this project
Posted Jan 8, 2025
Migrated data workflows to Pandas, managed 20+ Excel sheets with 1M+ records, automated updates with GUI, and streamlined operations for key clients like Huawei