Website for indexing/searching URL pages
Youssef Ben hammouda
Backend Engineer
Fullstack Engineer
Web Developer
Django
Python
React
The app was a crawling service that allows users to crawl websites (ethically using a defined user agent) the perform semantic searches on the content
I developed the backend using FastAPI.
The login system used LinkedIn as the sign-in/register option.
We hosted the Tensorflow models on Beam.cloud for scalability which Vertex AI doesn't support right now.
I have smoothly integrated the caching mechanism using Redis.
I have designed the database tables along with the relationships.
I ensured that all the SQL queries (SqlAlchemy) were optimized for the best performance.
