What if your PC could actually listen, understand, and do the work for you?

I’m building that idea into something real.

Meet AURA — my personal AI voice assistant for Windows.

Instead of building another chatbot that only answers questions, I’m experimenting with an AI agent that can actually interact with my computer and help with everyday work.

So far, AURA can:

• Have live voice conversations • Convert speech to text and respond with voice • Open applications like Excel, Power BI, Chrome, and Windows Settings • Search the web and YouTube through voice • Perform basic PC and file operations • Understand requests through Gemini • Execute actions through a safety-controlled automation layer • Continue listening after completing a task

But this is only the beginning.

My long-term goal is to make AURA understand my actual workspace — including what’s happening on my screen and inside applications — so I can simply say:

“Open my Excel file, check the sales data, clean the date column, and add a formula for total revenue.”

And let AURA handle the workflow.

I also want it to become useful for my own Data Analytics work — from Excel and Power BI workflows to repetitive desktop tasks, research, and automation.

I’m building AURA with Python, AI, voice technologies, desktop automation, Excel, Power BI, and LLMs, while keeping safety and human control at the core.

It’s still far from the final vision.

But that’s exactly what makes the project interesting.

I’m not just learning how AI agents work. I’m trying to build one that I can actually use every day.

Building in public. Learning by building. 🚀

#AI #AIAgents #Python #AIAssistant #VoiceAI #DesktopAutomation #DataAnalytics #PowerBI #Excel #Automation #BuildInPublic

The screen-reading step is where I would put the guardrail. Once AURA can read what is in the window, everything on that screen is input - and a page it opened from a voice search can hold a sentence written to be read as an instruction. I spent a while trying to rob my own...