We can Use the strength of LLMs to interact with your papers without an internet connection. No data ever leaves your execution environment, making it completely private. Without an internet connection, you may consume documents and ask inquiries!
Features :
Maximum Privacy: To ensure complete protection, your data is kept on your computer.
Support for a wide range of open-source models, including HF, GPTQ, GGML, and GGUF, is provided.
Various Embeddings: A variety of open-source embeddings are available.
Reuse Your LLM: After downloading, you may use your LLM again without having to download it again.
Chat History: Recalls the chats you've had inside a session.
API: You may use the LocalGPT API to create RAG applications.
Graphical User Interface: LocalGPT has two GUIs; one is standalone (based on streamlit), while the other leverages the API.
Supports numerous platforms out of the box, lets you chat with your data using CUDA, CPU, or MPS, and more! GPU, CPU, and MPS support!
Used Technologies:
