跪拜 Guibai
← All articles
Android · AI Programming

Three ways AI agents will call your Android app

By Carson带你学Android ·
Read original on juejin.cn ↗ Google Translate ↗ Alt translation

The way Google's agent infrastructure matures directly affects how users will interact with your app. Without structured integration, agents will still use your app, but through slow, error-prone screen simulation with uncontrolled data exposure.

Summary

Google is pushing Android toward an agent-aware platform. At the recent Dev Summit, the company detailed three integration paths: a formal MCP-based protocol via AppFunctions, an on-device Agentic API built on ML Kit, and a computer-vision fallback that lets agents see and tap the screen. Each path trades control, privacy, and integration effort. Most apps will likely combine the first two.

The MCP route exposes app features as annotated functions, so agents call them directly without parsing UI. The Agentic API runs a full agent loop inside the app on Gemini Nano 4, which is 3x faster than the previous Nano and keeps data on-device. The fallback, Computer Control Framework, works with zero integration but is slow, fragile, and sees all screen content. Google also showed A2UI, where agents stream JSON to render native Compose UI on the fly, currently in alpha.

The practical takeaway: if you want your app to be agent-friendly, start with AppFunctions and consider Agentic API for embedded assistants. Skipping integration leaves users to a slow, data-exposing fallback that Google itself calls transitional.

Takeaways
— Android MCP uses the AppFunctions library (androidx.appfunctions) to expose app features as annotated function signatures.
— The Agentic API provides automatic function calling, conversation history, orchestration loops, and built-in guardrails.
— Gemini Nano 4 runs on-device with 3x faster inference, up to 4x lower memory usage, 140+ language support, and function calling.
— Computer Control Framework requires zero integration but is slow, inaccurate, and exposes the entire screen to the agent.
— A2UI Compose Renderer lets agents stream JSON to generate native Jetpack Compose UI, currently in alpha.
— Connected Apps Platform places app features in Gemini and Google Search, currently in developer preview with a waitlist.
— The article recommends prioritizing high-frequency, clear operations when deciding which features to expose to agents.
— For sensitive data (payments, health), Android MCP + Agentic API keeps data on-device and gives developers control over exposure.
Conclusions

The three paths form a spectrum from full developer control to zero integration, with the fallback ensuring adoption but sacrificing user experience and privacy.

Google's strategy mirrors the web ecosystem: structured APIs like MCP are the equivalent of clean APIs, while Computer Control is the screen-scraping fallback for apps that haven't adapted.

The privacy advantage of on-device models is the strongest argument for Agentic API in sensitive categories, but the 3x speed gain also makes it viable for real-time interactions.

A2UI could fundamentally change how UI is built, but its alpha status and the fact that it relies on agent-generated layouts means it will take time to prove reliability.

Concepts & terms
MCP (Model Context Protocol)
A standard protocol that lets apps expose their capabilities to AI agents in a structured, machine-readable way, so agents can call functions instead of parsing UI.
AppFunctions
Android's Jetpack library for implementing Android MCP. Developers annotate functions to declare what an app can do, and agents call those functions with structured parameters.
Agentic API
An ML Kit API that runs an autonomous agent loop on-device, handling function calling, conversation history, planning, and guardrails without cloud dependencies.
Computer Control Framework
A Google fallback that lets agents operate an app by seeing the screen, recognizing UI elements, and simulating taps and swipes, without any app integration.
A2UI (Agent-to-UI)
A protocol where an agent streams JSON to render native UI components dynamically, replacing pre-built layouts with generated Compose interfaces.
Source: juejin.cn ↗ Google Translate ↗ Backup ↗