Provides a 360 degree view of the customer so that a Salesperson is well aware of all the facts when talking to customer. This gives a much better chance to close the deal.

 

This involves building a data lake. Data sources use Hadoop tools to transfer data to and from HDFS and some of the sources, were imported using sqoop, Then storing the raw data into HIVE tables in ORC format in order to facilitate the data scientists to perform analytics using HIVE. New use cases were developed and dumped into a NOSQL database (Hbase) for

further analytics.

• Developed SQOOP scripts to import the source data from Oracle database into HDFS for further processing.

• Developed HIVE Script to store raw data in ORC format.

• Involved in gathering requirements, designing, development and testing.

• Generated reports using Hive for business requirements received on ADHOC basis.

 

• Environment: Cloudera CDH 5.4.4

 

• Tech Stack: Hadoop, HDFS, Hive, Sqoop, Hbase.