Data-Driven Decisions: A Case Study in Product Analytics

Selvie Yang

0

Product Manager

Writer

Product Data Analyst

Figma

Mixpanel

Whimsical Wireframes

👀  Overview

Below, I provide a brief overview of the project's background and results. If you're interested in understanding directly how I arrived at this solution, please skip to My Role & Process section.

👂 Background

For a job-seeking platform, expanding our talent database is paramount. However, we've identified challenges with our onboarding process that are limiting potential talent from applying to jobs. Here are the key findings:
Challenge 1: The Mixpanel funnel graph indicates the highest drop-off rate occurs at the 2nd form during onboarding.
Challenge 2: Users who identify jobs they wish to apply for, but don't have an account, are directed to the onboarding form before they can apply, potentially causing friction.

📏 Formulating Hypothesis

Based on our findings, we've developed the following hypotheses:
Hypothesis 1: Overwhelming Single-Page Information Request Despite having only two steps in our onboarding, the final page consolidates all remaining questions. This could overwhelm users due to the sheer volume of queries presented at once.
Hypothesis 2: Lack of Direct Signup-to-Job Application Path Users without an account are rerouted to the onboarding process when they attempt to apply for a job. This creates an inconsistent user journey, where they are first asked to complete onboarding and then must revisit and click the apply button again

👂 Ideation Process

Ideation process based on identified issues:
Issue 1: High churn rate on the 2nd onboarding form
Key Questions:
How long are users taking to complete the form?
Can we eliminate or consolidate any questions to speed up the onboarding process?
Are there design optimizations that can improve user navigation and form completion?
Proposed Solutions:
Break the 2nd form into smaller, more digestible sections.
Transition to dropdown menus with suggestions to reduce user input time.
Remove questions that aren't crucial for employers when shortlisting candidates. End results: https://dealls.com/sign-up
Issue 2: Redirecting users without accounts to onboarding instead of allowing them to continue with the job application
Key Questions:
How many users drop off after being redirected to the onboarding page?
What's the average time users spend completing onboarding before returning to job application?
How long would a combined onboarding and job application process take?
Proposed Solutions:
Introduce a streamlined process allowing users to apply for jobs and create an account simultaneously.

🤭 Results

Achieved a 45% improvement in onboarding completion rate and increased job applications by 23%

💠 My Role & Process

This is a brief explanation on how we arrived at the solution:
Prioritize Key Metrics for Tracking
It's essential to track metrics, but having too many can be overwhelming. Focus on the ones that truly matter for your product's success.
To determine the most important metrics, consider the AAARR (Acquisition, Activation, Retention, Referral, Revenue) funneling process:
Acquisition: How are users discovering our product?
Activation: Are users taking the desired actions on our platform?
Retention: Are they continually engaging with our product?
Referral: Are users recommending our product to others?
Revenue: Are users willing to pay for our product?
By focusing on these five key stages, you can gain insight into user behavior, identify urgent areas of improvement, and ensure the product's long-term viability. Example:
Quantitative Data Analysis
Utilize analytics tools like Google Analytics, Mixpanel, Amplitude.
Establish a list of metrics to be tracked and subsequently create relevant graphs.
Monitor performance weekly and respond swiftly to any signs of decline by:
Examining the graph in detail.
Identifying stages with the highest churn.
Analyzing the data trend — is it recurring or a one-time event?
Hypothesis Formulation
After data collection, frame hypotheses in a clear Title & Subtitle format for better comprehension.
For each hypothesis, compile essential questions for further quantitative or qualitative analysis. To enhance brainstorming and ideation, empathize from a user's perspective, utilizing the 5W+1H framework
Usability Testing
Complement quantitative data with qualitative insights from customers.
Target those who align with the formulated hypotheses, especially users who drop off midway in your funnel.
Lo-fi & Wireframe
Consolidate improvement points for the upcoming backlog.
Prioritize and benchmark, adopting standout features from other platforms.
Draft a lo-fi solution using tools like Whimsical for ideation and wireframing.
Hi-fi Creation
Partner with designers to finalize a hi-fi version, building on user insights.
Engaging with designers can reveal additional UX behaviors and optimization opportunities.
Iteration Present the refined version to users and iterate based on feedback.
Launch Proceed to the development phase and launch the updates after a sprint.
Like this project
0

Posted Dec 26, 2024

Selvie leveraged product analytics to boost feature adoption by 15%, providing insights that improved decision-making and enhanced product performance.

Likes

0

Views

1

Tags

Product Manager

Writer

Product Data Analyst

Figma

Mixpanel

Whimsical Wireframes

Customer Relationship Management Revamp with Zendesk
Customer Relationship Management Revamp with Zendesk
Creating Scalable Standards: PRDs, QA Guidelines, and SOPs
Creating Scalable Standards: PRDs, QA Guidelines, and SOPs