Financial Data Handling (AWS)
Ashish Sharma
Data Visualizer
Financial Consultant
Data Engineer
AWS
Power BI
SQL
Clix Capital
◦
Objective
– To develop big
data solution on AWS with data security and pre-prod environment.
◦
Challenge
– To understand business,
systems, portfolios, and user requirements.
◦
Approach
– Data masking in S3, data cubes in DB and
pre-prod env for better data quality.
◦
Solution
– Implemented encrypted
data masking through ciphertext in S3, transformation layer in AWS Databricks,
reporting DB in AWS Redshift and Analytics in Power-BI.
◦
Result
– PII and Non PII data segregation for data
security, data cubes for smooth dashboards and achieved 10x faster time for the
business transformations on 18+ TB data.