How to Use Gemini Guided Vision in Live on Android
Turn on Gemini Guided Vision on Android, add shortcuts, and get spoken camera help for labels, objects, and rooms.
Gemini Guided Vision turns a Live camera session into spoken help. Point your Android phone at a label, a shelf, or a room and ask what you are looking at. Google built the feature with blind and low-vision communities, and it now sits inside Gemini Live rather than a separate app.
The feature is rolling out slowly. If the toggle is missing, update Gemini and wait. Google says Guided Vision is coming to phones on Android 9 or later in countries where Gemini is available.
This guide follows Google’s own help pages. It covers setup, shortcuts, useful prompts, and the limits you should treat as hard rules.
What Guided Vision actually does
Guided Vision is not a still-photo reader. You start a Gemini Live chat, share the camera, and talk while the viewfinder is open. Gemini describes what it sees and can tell you how to move the phone if the frame is off.
Official examples from Google include:
- Reading fine print on a food label
- Ordering from a menu in a dim restaurant
- Identifying household objects
- Checking whether a shirt color or pattern matches pants
- Finding an item in a cabinet, such as pepper among spices
- Describing a room layout or locating a dropped earbud
Google also lists translation of text in the environment: signs, appliance displays, and small labels.
If the camera is not lined up, you get spoken cues to reframe, pan, or center the object. That feedback is the difference between a one-shot photo question and a live session.
Turn Guided Vision on in the Gemini app
Do this first. Shortcuts only work after the feature is enabled.
- Update the Gemini app from Google Play.
- Open Gemini on your Android phone or tablet.
- Tap your profile picture or initial at the top, then tap Settings.
- Turn Use Guided Vision in Live on.
- If a notification appears, you can tap Start Live to open a Live chat right away.
Once the setting is on, start Live as you normally would and share the camera. To stop, tap End Live session.
If you cannot find the toggle, the rollout has not reached your account yet. Google’s accessibility help page states the feature is rolling out slowly over time.
For how Live itself works, including camera and screen sharing, see Google’s Gemini Live help article. Related camera tools on Pixel are covered in our September 2026 Android Drop guide.
Add a shortcut so you can start it one-handed
Opening Gemini, starting Live, and tapping the camera takes several steps. Google lets you bind Guided Vision to Android accessibility shortcuts.
Accessibility shortcut
- Open the device Settings app.
- Tap Accessibility.
- Under Vision assistance, tap Guided Vision.
- Turn Guided vision shortcut on.
- Tap the shortcut row and pick one trigger:
- Accessibility button — tap the floating button
- Accessibility gesture — swipe up from the bottom with two fingers
- Volume keys — press and hold both volume keys
Google’s general shortcut help lives at the Android Accessibility shortcuts page. The same volume-key hold is used by other accessibility tools, so pick one owner for that gesture if you already use TalkBack or Magnification.
TalkBack menu
If you use TalkBack:
- Update TalkBack from Play Store.
- With TalkBack on, tap the screen with three fingers to open the TalkBack menu.
- Choose Guided Vision.
Early testers report that the TalkBack item and the Accessibility settings row can lag behind the Gemini app toggle. If only the Gemini setting is present, use that path until the system shortcut appears.
Start a session and share the camera
A typical first run looks like this.
- Grant camera and microphone access when Gemini asks.
- Start Live from the Gemini app, from “Hey Google, let’s talk Live,” or from the Guided Vision shortcut.
- Share the camera from the Live screen.
- Hold the phone so the lens points at the object. Keep it 20–40 cm away for labels.
- Ask a specific question out loud.
- Follow spoken framing cues if Gemini asks you to pan or center.
- End the Live session when you are done.
Ask permission before you point the camera at other people. Google’s Live help page tells you to respect privacy before recording or including someone in a Live chat.
Lighting matters. A bright, steady frame beats a dark, shaking one. If Gemini keeps asking you to reframe, rest your elbows or prop the phone against a stable surface.
Prompts that work better than “what is this”
Guided Vision answers what you ask. Vague prompts get vague audio.
Try:
- “Read the ingredients on this label, starting with allergens.”
- “Translate this menu into English and list the vegetarian dishes.”
- “Where is the pepper in this spice rack, left or right of the camera?”
- “Does this navy shirt clash with these grey trousers?”
- “Describe the layout of this room from the doorway.”
- “What does the oven display say right now?”
Google’s own task list maps cleanly onto those prompts: read or translate text, identify objects, describe color and pattern, and understand surroundings.
Keep the question tied to the current frame. If you walk to a new shelf, say so. Live is a conversation, not a one-shot scan.
Limits you should treat as policy, not fine print
Google’s warning is explicit. Guided Vision can make mistakes. It is not a medical device, mobility aid, or substitute for a travel guide. Do not use it for navigation or obstacle detection. You stay responsible for your health and safety.
That means:
- Do not cross a street based on a Live description.
- Do not treat object “found” audio as a guarantee in a crowded room.
- Double-check medicine labels and allergen lists with a second method when the stakes are high.
- Expect errors on reflective packaging, tiny type, and low light.
Guided Vision is also separate from Pixel Camera features such as Guided Frame and Scene Description. Those tools help you take a photo. Guided Vision is a Gemini Live conversation with the camera on.
Requirements and rollout notes
From Google’s September 2026 Android Drop and the accessibility help article:
- Phones running Android 9 or later
- Gemini available in your country
- Gemini app updated, with Live and camera sharing working
- Gradual rollout, so two phones on the same OS may not get the toggle on the same day
You do not need Android 17. You do not need a Pixel. OEM skins can hide Accessibility rows in different menus, but the Gemini app path is the same.
If Live works and the Guided Vision toggle is still missing after an update, wait. Forcing the feature with a third-party overlay is not supported.
Tips that save time after the first week
- Bind the volume-key shortcut only if you do not already use that hold for TalkBack.
- Practice on a cereal box at home before you rely on it in a store aisle.
- Name the object in the prompt so Gemini knows what to lock onto.
- End Live when you put the phone in a pocket. A live camera session burns battery and can keep the microphone hot.
- Review Gemini activity settings if you do not want Live sessions stored.
Pair Guided Vision with other September tools when they fit. Find Hub remembered items help you store a location you already know. Guided Vision helps you identify what is in front of you now. They solve different problems.
Conclusion
Guided Vision is useful when you need spoken detail from a live camera, not a gallery of saved photos. Turn it on in Gemini settings, add a shortcut if the system row has arrived, and ask tight questions about the frame.
Stay inside Google’s stated limits. Treat every description as assistance, not a navigation system. When the toggle shows up on your phone, a five-minute practice session at home is enough to learn the framing cues.
Sources
Share this story
