SGE Bank Data Archive System

Overview:

Led a team to develop a comprehensive data archival system for Societe Generale Expressbank (SGE) following its merger with another bank. The system serves as a unified platform for viewing an array of transactional data, consolidating information from multiple databases into a single Oracle database.

Objectives:

ETL Transformation: Executed the Extract, Transform, Load (ETL) process, collating data from MS SQL and Oracle databases into a redesigned Oracle database. Ensured optimization for rapid data retrieval.

Data Accessibility: Created interfaces for viewing data related to core banking, Western Union transactions, SWIFT transactions, online banking, ATMs, POS transactions, and terminals.

Data Export: Incorporated functionality to export data in multiple formats (.CSV, .XLSX, .PDF).

Role Management: Added features for user role management to secure access to different levels of data.

Technical Specifications:

Backend: Deployed .NET Core for the API development, adhering to the repository pattern for maintainability and ease of testing.

Frontend: Adopted and customized Vue.JS material dashboard to fit client needs.

Database: Utilized Oracle DB and employed EF Core as the Object-Relational Mapping (ORM) solution.

ETL Process: Utilized Oracle ODI for ETL transformations, involving tasks such as database redesign, column conversion, adding foreign keys, and other optimizations.

Key Achievements:

Leadership & Development: Served as both team leader and full-stack developer, overseeing all project phases from database setup and architectural design to frontend development.

Data Handling: Successfully handled a data load of over 10 terabytes, ensuring the system could manage large sets of data efficiently.

Performance Optimization: Employed various optimization techniques in ETL and database design to enable fast data retrieval.

Data Privacy: Implemented stringent security protocols to ensure all sensitive information remained censored and protected.