Everyone's shipping AI demos. Almost nobody writes about what breaks when real users and real mon...Everyone's shipping AI demos. Almost nobody writes about what breaks when real users and real mon...
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Everyone's shipping AI demos. Almost nobody writes about what breaks when real users and real money hit them. So I'm going to. Twelve posts on the unglamorous problems behind production systems I've built solo. Once a while: 01/12
Most RAG demos retrieve the wrong chunks, mine runs hybrid pgvector + Postgres full-text, RRF fusion, then a cross-encoder rerank.
The Anthropic/OpenAI SDK will hang your app for 10 minutes on its default timeout here's the failover chain that fixes it.
I let an LLM write SQL against a customer's live database ,and the schema guardrail that keeps it from doing damage.
Nobody talks about billing for AI - I meter every token so no call ever goes unbilled, per tenant.
Half of enterprise documents are scans your RAG silently can't read - the OCR fallback path, with cost caps.
Chat memory isn't a chat array - server-side history and result replay so reopening a conversation costs zero tokens.
hls_time=2 did nothing and my 10-second video stayed one segment - the keyframe/GOP bug, and the one flag that cut it into exact 2.000s chunks.
Gating premium video without Widevine - capability tokens, per-request takedown re-checks, presigned segment redirects.
I costed out 10,000 users before writing a line of code - and why "10k users" secretly means three different things.
When should software refuse to act without a human? The gates I build to stop the machine on purpose.
In multi-tenant systems, one bug leaks everyone's data - isolation, RBAC, audit logging, instant token revocation.
Routing delivery riders through a city with no street addresses - zone maps, walk-graph sequencing, dispatch. #systemdesign #AI #softwareengineering
Post image
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started