Development of a BI and Analytics Solution for a Regulatory Auth

The Customer is a financial regulatory authority responsible for capital markets. The Customer’s functions include supervising and issuing licenses to market intermediaries and monitoring their activities.

With the aim to oversight market and conduct market research, the Customer employed varied data source systems – a risk-based supervision system, a surveillance system for monitoring marketing activities, Excel databases, an upload web portal for registered entities, etc. However, the inability to consolidate these data sources for in-depth analysis hindered advanced supervision and raised difficulties for regulatory policies development and financial analysis. Thus, the Customer was looking for a vendor that could help them establish a centralized BI platform with robust analytics capabilities.

DataDesignCenter's business intelligence team analyzed the Customer’s business objectives and defined optimal features for the future solution:

1.Integration and management of disjoint data sources across the organization, including the web portal used for receiving the documents from registered entities required for financial analysis

2.Multi-source data analysis to support informed decision-making and proactive capital market regulation

3.Comprehensive financial analysis, including financial models implementation, trend analysis, compliance check analysis, multidimensional statement analysis, etc

4.Custom reports and dashboards aligned to different user needs across the company’s departments

5.Scheduled and ad-hoc reporting capabilities

6.Data access based on user roles and permissions

DataDesignCenter's team designed the solution’s architecture, which consisted of three layers:

1.Data staging (integration) layer – data extraction from heterogeneous internal and external data sources, its further transformation and loading into the DWH

2.Data warehousing layer – data receiving and storing for further analysis

3.Business intelligence layer – scheduled and ad-hoc analytics and reporting for end users

The BI team delivered the solution, which consisted of the following components:

1.Data integration platform

To consolidate data from the Customer’s data sources, DataDesignCenter’s team built the staging layer with the Extract, Transform, Load (ETL) processes. The ETL pipeline enabled data retrieval (either in batches or micro-batches), data cleansing, validation, processing, quality testing, refining, filtering, tuning and master data management.

2.Data warehouse

The cleaned, formatted, reorganized, summarized and supplemented data was then loaded for storage into the DWH, which became the main source of information for analysis and report generation.

The team also added an analytics sandbox to the DWH. This separate environment supported experimental or development analytics activities, which allowed the Customer to create, test and deploy their own analytics models

The Customer has obtained a fully functional and highly secure BI and analytics solution to monitor and manage their data for in-depth financial analysis, automate data flows, develop custom analytics models. The delivered solution supports 200+ concurrent business users handling over 500 reports simultaneously, which leads to optimized business operations and accelerated decision-making.