I built our AI agent's memory system three times. The first version was embarrassing. Every timeI built our AI agent's memory system three times. The first version was embarrassing. Every time
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
Youssef's avatar
Youssef El Fajlaoui
• Jul 10
I built our AI agent's memory system three times. The first version was embarrassing.
Every time the user said something, the agent stored it as a string in SQLite. Every time the user asked a question, it ran a basic SQL query: WHERE content LIKE '%keyword%'
It wasn't a memory system. It was a search bar with persistence.
If a user said "I'm frustrated with my job," and later asked about "stress at work," the agent found nothing. The words didn't match. The agent was deaf to meaning.
Here is what we learned building and auditing the ARIA memory engine (now Silex Engine):
Storing is Not Learning During our system audit, we found the agent was generating deep self-reflections at every turn ("I should have asked for clarification before answering"). But the code that built the system prompt never read them back. The agent was reflecting on its performance, storing it in the database, and immediately forgetting it. Memory that does not influence future behavior is not memory. It is just a log.
Facts vs. Relationships A flat database lists facts: "I use React" and "I use TypeScript." An intelligent agent needs a world model that draws a "co-occurs with" edge between them, reasoning that the developer operates in a modern type-safe JavaScript ecosystem.
How we architected our V3 hybrid memory stack: • SQLite: For fast, persistent session storage. • ChromaDB: Vector search for semantic retrieval (stress at work ➔ job frustration). • NetworkX Causal Graph: To map relationships (causes, requires, contradicts) between facts. • Consolidation Cycle: A weekly scheduler that clusters related nodes and synthesizes them into abstract user profiles.
Building cognitive memory isn’t about database storage. It’s about closing the retrieval loop so the agent actually changes its behavior based on what it learned.
I wrote a full breakdown of our memory audits and how we built the Silex Engine's memory core: https://openyf.dev/blogs/aria-causal-memory
#AIAgents #SoftwareArchitecture #GraphDatabases #NoSQL #SystemEngineering
Post image
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started