Scalable Recommendation System for Social Media Platform

Nilesh Hirani

0

Data Scientist

Backend Engineer

ML Engineer

Apache Airflow

Kubernetes

TensorFlow

In this project, I developed a cutting-edge recommendation system powered by a Field-aware Factorization Machine (FFM) for collaborative filtering. The system leveraged various input signals, including explicit ones like likes and comments, as well as implicit ones like video playtime and skips, to generate personalized recommendations for users on a social media platform.
To ensure efficient and seamless updates, I implemented an incremental training approach, allowing the model to be tuned and updated without the need for complete retraining, thereby minimizing computational resources and downtime.
The trained model was deployed as a highly scalable service, capable of handling substantial throughputs exceeding 50,000 requests per second, ensuring a smooth and responsive user experience.
Collaborating closely with product teams, I conducted extensive A/B testing to optimize user engagement and retention metrics, iteratively refining the recommendation system's performance based on real-world user data and feedback.
Like this project
0

Posted May 12, 2024

Developed a scalable FFM-based recommendation system for social media, handling 50K+ RPS, optimized through A/B testing

Likes

0

Views

0

Clients

ShareChat

Tags

Data Scientist

Backend Engineer

ML Engineer

Apache Airflow

Kubernetes

TensorFlow

Real-Time ANN as a Service Platform
Real-Time ANN as a Service Platform
Retrieval-Augmented Generation (RAG) System
Retrieval-Augmented Generation (RAG) System