RAG and Text-To-SQL LLM for ThisFish
Beatrice Bu
Client: ThisFish (Seafood Traceability Software Company)
Technology Stack: Google Cloud Run, LLM (Gemini), AlloyDB for PostgreSQL, Retrieval-Augmented Generation (RAG), GCP Document AI, PyMuPDF, Pandas.
I designed and lead the implementation of a robust endpoint on Google Cloud Run tailored for ThisFish, leveraging advanced AI and cloud technologies to enhance their seafood traceability solutions. This project focused on two primary use cases:
Seafood Safety and Legal Policy Query Endpoint:
Functionality: Developed an endpoint where users can query detailed information about seafood safety and specific legal policies related to seafood factories. The solution integrates a Large Language Model (Gemini), connected to a vector database on AlloyDB for Postgres loaded with embedded client safety files. Factory workers can easily ask the model about specific health and safety guidelines or factory policies without having to leave the factory.
Benefits: This setup ensures that workers have instant access to precise and comprehensive information on seafood safety and legal regulations, promoting compliance and informed decision-making on the factory floor.
Natural Language Reporting System:
Functionality: Built a reporting system that empowers non-technical users to query their factory databases using natural language. Gemini converts the natural language queries into SQL, retrieves the relevant data, and returns the results in natural language. This use case required extensive system prompting and utilized Gemini's context caching functionality to deliver accurate and context-aware responses.
Benefits: This innovative solution allows users without technical expertise to generate detailed reports and insights from their factory databases, enhancing accessibility and efficiency in data-driven decision-making.
Impact: This project significantly enhances ThisFish's ability to provide accurate and reliable seafood traceability information, fostering greater transparency and trust in the seafood supply chain. By enabling real-time access to critical safety guidelines and facilitating intuitive data queries, the solution supports operational excellence and regulatory compliance.
Like this project
Posted Aug 3, 2024
Developed an endpoint for ThisFish using RAG AI and Gemini to provide real-time seafood safety info and natural language database queries on Google Cloud Run.
Likes
0
Views
13
Clients
ThisFish
