End to end data analytics
Bogdan Drema
Like this project
Posted May 23, 2024
Setup end to end analytics pipeline. From integrating UI events to capture data, processing and cleaning the data, to creating the chart to display it.
Likes
0
Views
8
What
Capture events from the UI and server side events. Store the events. Process and filter the data. Charts and tables to display analytics results.
UI chart output
Contribution
Configured Jitsu for analytics capture and hooked in UI components for various interactions such as video played 10%, link clicks, inbound/outbound traffic and more.
Used DBT to manage complex SQL queries to enrich data with session information and metric extraction into final daily windowed chunks.
Created tables and charts with date range that aggregated the days from the previous steps into results and trends compared to previous dates.
Lessons learned
Testing the results of the analytics was tricky. Breaking each step down during the pipeline and the testing makes sure all the components are working correctly. For example ensuring the event data is captured correctly, then data tests to ensure the analytics data is within expectations.