AI News Feed
Market watch
Products & Applications

Google launches Guided Vision in Gemini Live for blind and low-vision Android users

Google launches Guided Vision in Gemini Live for Android, giving blind and low-vision users spoken camera descriptions.

Once a user shares the camera in Gemini Live, Guided Vision can describe surroundings, read small labels, identify appliance controls, help find a dropped earbud or an item in a crowded cupboard, match clothing colors, and describe an unfamiliar room, according to Google. If Gemini needs a better view, it can ask the user to pan right, tilt down, or step back. The feature also supports conversations across multiple languages.

Guided Vision works on devices running Android 9 or newer in regions and languages where Gemini Live is supported. Users can enable it from Gemini's settings, Android's Accessibility menu, or directly through TalkBack, and an accessibility shortcut can jump straight into the feature. Android Authority reported that Google had been building toward the feature with Gemini Live for more than a year, first adding visual guidance that could highlight objects on-screen, and that Google previewed the finished experience in September before saying it was coming soon. The Verge reported that Guided Vision was announced in a recent set of Pixel updates.

Google said it developed Guided Vision with the accessibility service Aira, including more than 1,000 members of Aira's Trusted Tester network. The Verge noted that the feature is similar to Apple's VoiceOver Live Recognition, which is available on the iPhone and Vision Pro, and is designed for people who are blind, have low vision, or want assistance in specific situations. In addition to the Gemini app, Guided Vision is available in Google TalkBack, or users can set up an accessibility shortcut in Settings on devices running Android 9 and above.

Google cautions that Guided Vision can make mistakes and should not be relied on for navigation, safe-travel guidance, or obstacle detection, or as a replacement for a white cane or other mobility aid. The company also said users can ask follow-up questions about what they are looking at, such as asking Gemini to read the expiration date on an item it helped them find, and that Gemini will give audio cues to help line up the camera if the user asks about something not in the shot.