LLM Solutions - Implementing Chatbot with Python / AI models
Mark Sun
Fullstack Engineer
Docker
Google Cloud Platform
Python
I have implemented Chatbot system which can automate the end-user's messages by using various AI models. Here I designed backend architecture and Restful API endpoints for frontend and chatbot, and implemented the system by using FastAPI frameworks.
Here I integrated various AI models such as OpenAI, Langchain, Pinecone, and various AI models such as Image tagging service, RunPod based product suggestion system and etc..
Also I deployed this backend on Google Cloud Platform by using Git CI/CD pipeline as docker images, and integrated Grafana/Prometheus for metrics.
I implemented the Frontend website by using React framework for end-users