Building a Voice AI Assistant That Turns Phone Calls Into Thoughtful Follow‑Through
I built a Django backend for a family-focused AI phone assistant. A registered caller connects through Twilio, and Django Channels streams the call to an OpenAI Realtime session for a natural, two-way conversation.
The backend adds caller-specific context, selected voices, subscription minute limits, and interruption handling. After the call, background tasks generate a separate summary. A follow-up email is sent only when requested and the recipient is confirmed.
I also built APIs for managing relations, subscriptions, and dashboard usage data. One of the most interesting parts was connecting the whole lifecycle: incoming call, real-time conversation, usage tracking, and post-call follow-through.
Sending the follow-up email only after the recipient is confirmed is a careful rule: a wrong name heard on a call could send it to the wrong person. How does the confirmation work: does the assistant repeat the name during the call, or does the caller confirm later in the dashboard?
I think we're heading towards a stage where everyone will have their own unique tools and workflows, which they won't even bother sharing or selling, knowing others can simply reverse-engineer and adapt them. Feels like we're entering an era of truly unique creativity.