Building a Local AI Chat App Using Next.js and Transformers.jsBuilding a Local AI Chat App Using Next.js and Transformers.js
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Since Friday (May 15, 2026), I have been building a local AI chat app of my own with the help of generative AI🚀 The main reason is to use Gemma 4 on my laptop in an environment where I can expect what will happen. In addition, this project has been helping me learn a lot about how vibecoding tools work under the hood! This chat app is built under the following setup: • Next.js • Two API Routes, separating LLM inference from the back-end part of the app • Transformers.js (running on the server side) • The ONNX q4 version of gemma-4-e2b-it Note that this chat app is still in development and, despite its name, has not got any built-in tools yet. However, a first step is very important in app building, isn't it? I hope that this post inspires anyone to build their own local AI chat app!
See the comment section for additional notes (if any).
Post image
Emman's avatar
Good work! 🔥 I agree that the first step is quite important. Have you thought of any UI/UX stack you'll use for this?
Shun's avatar
Post author notes will be added to this thread of replies.
Shun's avatar
Here is a post on X where I shared this AI chat app building project! https://x.com/_shun0t/status/2055662929782174141
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started