Offline LLM Chatbot (Ollama + FastAPI) by Josh McdonaghOffline LLM Chatbot (Ollama + FastAPI) by Josh Mcdonagh

Offline LLM Chatbot (Ollama + FastAPI)

Josh Mcdonagh

Backend Engineer

Software Engineer

AI Engineer

Ollama

Python

Artificial Intelligence

Like this project

Posted Jun 20, 2025

Built a self-hosted AI assistant with FastAPI and Ollama. Parses PDFs and responds privately using local models like Mistral.

Likes

Views

Join 50k+ companies and 1M+ independents

Resources

Hire Freelancers

Explore all Top independents Design Engineering Marketing Music & audio Social media Video & animation Product Business consulting & HR Other

Contact

Contact support

Company

Mission Careers Terms & conditions Privacy policy Cookie policy

Offline LLM Chatbot (Ollama + FastAPI)

Josh Mcdonagh

Backend Engineer

Software Engineer

AI Engineer

Ollama

Python

Artificial Intelligence

Like this project

Posted Jun 20, 2025

Built a self-hosted AI assistant with FastAPI and Ollama. Parses PDFs and responds privately using local models like Mistral.

Likes

Views

Join 50k+ companies and 1M+ independents

For independents

Contra Pro Manage freelance projects Get verified as an expert Find jobs Get discovered Sign contracts Send invoices Commission-free payments

For companies

For companies Manage team projects Share hiring workspace Post jobs Discover contractors Sign contracts Approve invoices Global payments & tax compliance

Use Cases

For companies For freelancers For creator tools For agencies For VCs

Resources

Hire Freelancers

Explore all Top independents Design Engineering Marketing Music & audio Social media Video & animation Product Business consulting & HR Other

Company

Mission Careers Terms & conditions Privacy policy Cookie policy

Contact

Contact support

For independents

Contra Pro Manage freelance projects Get verified as an expert Find jobs Get discovered Sign contracts Send invoices Commission-free payments

For companies

For companies Manage team projects Share hiring workspace Post jobs Discover contractors Sign contracts Approve invoices Global payments & tax compliance

Use Cases

For companies For freelancers For creator tools For agencies For VCs

Resources

Hire Freelancers

Explore all Top independents Design Engineering Marketing Music & audio Social media Video & animation Product Business consulting & HR Other

Contact

Contact support

Company

Mission Careers Terms & conditions Privacy policy Cookie policy