AI Agent That Uses an Android App Like a Person by Yutaro T.AI Agent That Uses an Android App Like a Person by Yutaro T.

AI Agent That Uses an Android App Like a Person

Portfolio project
Yutaro T.

The idea

Product people often ask "what does this screen look like right now?". This agent answers by actually opening the app.

How it works

Runs the production Android app in an emulator
Operates it the way a person does, through adb and UI Automator, using on-screen labels instead of coordinates
Reads the screen and replies in Slack with screenshots
Needs no changes to the app and no special test builds

Measured

About 3 seconds per action
A full crawl covers 60 screens in 35 minutes

Stack

Python, Shell, adb, UI Automator
The client and app names are not shown.

0 likes · 0 views · Nov 12, 2026

An agent that uses a production Android app the way a person does, reads the screen and answers product questions in Slack with screenshots. About 3 seconds per action; a full crawl covers 60 screens in 35 minutes. No app changes needed.

Timeline

Aug 25, 2026 - Aug 26, 2026

Tags