Guided Vision is launching in Gemini Live on compatible Android devices today to use AI to give real-time audio descriptions of anything you point your phone’s camera at. By sharing your camera in Gemini Live, you can have Google’s AI help with things like reading small text, describing your surroundings, finding or identifying objects around you, and describing details on specific objects.
Like the VoiceOver Live Recognition feature Apple has added to the iPhone and Vision Pro, it’s designed for people who are blind, have low vision, or want assistance in specific situations. In addition to the Gemini app, Guided Vision is also available in Google TalkBack, or users can set up an accessibility shortcut for it in the Settings app on devices running Android 9 and above, after it was announced in a recent set of Pixel updates.
You can also ask follow-up questions about whatever you’re looking at, like asking Gemini to read off the expiration date on an item it helped you find. Google says Gemini will give you audio cues to help line up your camera if you ask about something that’s not in the shot. However, Google cautions users not to rely on Guided Vision for things like “navigation, safe-travel guidance, or obstacle detection,” or as a replacement for a cane or mobility aid.