This project focused on extend a working but rudimentary MVP written in Python and relating video and audio streaming, natural language processing, real-time audio and video processing, and fuzzy / contextual search, including but not limited to using LLMs for contextual search and matching.
This project took an API first approach so, Pythons Fastapi framework was used as the backend with the frontend built on bubble. Emphasis was placed on reliability, resilience and roboustness so while integrating services like zoom, twilio, youtube and a couple of other streaming services, the use of network failure fallbacks, independent worker process and dynos were imperative.
I particularly enjoy working on this project because I now have a better understanding of how streaming services work and the hardwork that go into building something as simple as a voip call.