How to Use Gemini Screen Automation on Android Phones

Google expanded Gemini Intelligence features in the November 2026 Pixel Drop and related updates. Screen automation lets the Gemini app on Android handle multi-step tasks inside select apps on your behalf. You stay in control while Gemini navigates the interface in a virtual environment.

This works on supported Pixel and Samsung devices for users 18 and older in India, Japan, South Korea, the UK, and the US. Pixel 10 devices are not supported in South Korea. Availability rolls out gradually and requires a personal Google account.

What Screen Automation Does

Screen automation is a beta feature in the Gemini mobile app. It opens the relevant app in an on-device virtual phone environment and interacts with the screen. Examples include booking a ride, ordering food or groceries, adding items to a cart, or preparing a reservation.

Gemini works in the background even if you close the chat. It shows live progress. You can stop the task at any time. For the final step such as confirming a payment or booking, you take over or confirm yourself. Gemini does not enter payment details or passwords on its own.

It differs from Connected Apps or the Tasks feature in Gemini. If an app is available as a Connected App, Gemini prefers that path. Screen automation applies when the app is not connected that way.

Supported Devices and Requirements

You need a supported device:

• Pixel 10, Pixel 10 Pro, Pixel 10 Pro XL, Pixel 11, Pixel 11 Pro, Pixel 11 Pro XL, or Pixel 11 Pro Fold.
• Samsung Galaxy S26 series, Galaxy Z Flip 8, Galaxy Z Fold 8, or Tab S12 series.

Additional requirements:

• Age 18 or older.
• Location in India, Japan, South Korea, the UK, or the US (with the Pixel 10 exception noted above).
• Signed in with a personal Google Account. Work, school, or supervised accounts do not support it.
• Language set to English, Japanese, or Korean for the supported apps.

The feature appears in the Gemini app. Activate Gemini by opening the app, using the power button, or saying “Hey Google.”

How to Start a Task

1. Open the Gemini mobile app on your Android phone.
2. Tell Gemini the task with clear details. Examples from Google support: “Book a ride to the airport,” “Reorder my last coffee,” “Add milk and eggs to my grocery cart,” or “Order pizza for delivery.”
3. The first time you use screen automation or use it with a specific app, follow the on-screen prompts to grant the Google app permission for screen automation.
4. Gemini may ask follow-up questions, then create an action plan. Review the plan and confirm or adjust it with another prompt.
5. Gemini begins the task in the virtual environment. Monitor progress via the chat or the system notification.
6. Complete any final confirmation step yourself when prompted.

You can also start with a photo or shared screen. For instance, share a photo of a location and ask Gemini to book a nearby hotel.

Viewing, Stopping, and Taking Control

Gemini completes tasks using the on-device virtual phone. Tap View progress in the chat or notification to see the live screen.

On supported devices you can tap Take control to step in. On Pixel 10 and Galaxy S26 series, the current implementation focuses more on stopping the task rather than full take-over in every case. Stop the task by tapping Stop task in the chat text box or in the live update notification.

If you leave items in a cart without completing an order, they may remain there. On Galaxy Z Flip 8 and Z Fold 8, if Gemini asks you to take over and you do not act within 10 minutes, it stops the task.

Managing Permissions

Change screen automation permissions anytime:

1. Open the Gemini app.
2. Tap your profile picture or initial at the top.
3. Go to Settings > Screen automation.
4. Select the app and choose Always allow, Ask every time, or Do not allow.

This permission lets Gemini read and interact with the app’s screen content for the task.

Limits and Safety Notes

Daily request limits apply and depend on your Gemini subscription tier. Gemini notifies you when you approach the limit. Simultaneous tasks are also limited.

Because this is a beta feature, Gemini can make mistakes. It might tap the wrong item, add an incorrect quantity, or misunderstand an instruction. You remain responsible for actions taken during a task, including any purchases.

Do not enter sign-in information, payment details, or other sensitive data directly into the Gemini chat. Enter those inside the actual app after taking control. Avoid using the feature for emergencies.

Google designs safeguards such as confirmation requests before certain actions, recognition of prohibited tasks, and restrictions to relevant apps. These do not eliminate all risks. Monitor important tasks closely. You can stop the process at any moment.

Tips for Better Results

Be specific in your prompt. Include time, location, size, or preference details up front so Gemini asks fewer clarifying questions.

Start with simple, familiar tasks such as reordering a previous coffee or adding common grocery items while you learn how the virtual environment behaves.

Check the Screen automation settings after a system update or if the option does not appear. Server-side rollout means the feature may arrive later for some accounts even on supported hardware.

For related Gemini Intelligence capabilities such as Rambler voice typing or custom widgets on Pixel devices, see our guide on the November Pixel Drop features.

Conclusion

Gemini screen automation turns multi-step app interactions into a single request on supported Pixel and Galaxy devices. You describe the outcome, review the plan, and stay ready to confirm or stop. Combined with the broader Gemini Intelligence updates rolling out in late 2026, it reduces switching between apps for everyday logistics.

Check your device, region, and account eligibility, grant the necessary permission once, and test a low-stakes task. Official support pages list current device and language coverage as the feature expands.

Sources:

• Google Support: Ask Gemini to handle your multi-step tasks in select Android apps (support.google.com/gemini/answer/16940971)
• Google Blog: Gemini Intelligence features and new device support (blog.google, November 10, 2026)
• Related: Gemini Intelligence on Pixel 10 November Drop guide