Google’s accessibility app Lookout can use your phone’s camera to find and recognize objects

Google has Updated some of your accessibility apps to add features that will make them easier to use for people who need them. Launched a new version of Look application, which can read texts and even long documents aloud for people with low vision or blindness. The app can also read food labels, recognize coins and tell users what it sees through the camera and in an image. Its latest version comes with a new “Find” mode that allows users to choose from seven categories of items, including seats, tables, vehicles, utensils and bathrooms.

When users choose a category, the app will be able to recognize objects associated with them as the user moves their camera around the room. It will then inform the direction or distance of the object, making it easier for users to interact with the environment. Google also launched an in-app capture button so they can take photos and quickly get AI-generated descriptions.

The company updated its Look to talk app too. Look to Speak allows users to communicate with others by selecting from a list of phrases they want the app to speak out loud, using eye gestures. Now, Google has added a textless mode that gives the option to trigger speech by choosing from a photo album containing various emojis, symbols and photos. Even better, they can customize what each symbol or image means to them.

Google has also expanded its screen reader capabilities to Lens in Maps, so it can tell the user the names and categories of places it sees, like ATMs and restaurants. It can also tell you the distance to a certain location. Additionally, improvements are being made to detailed voice guidance, which provides audio prompts that tell the user where to go.

Google has finally made Maps wheelchair information accessible on the desktop, four years after it had released on Android and iOS. The Accessible Locations feature allows users to see if the location they are visiting meets their needs – businesses and public places with accessible entrances, for example, will show a wheelchair icon. They can also use the feature to see if a location has accessible bathrooms, seating, and parking. The company claims that Maps has accessibility information for more than 50 million places right now. Those who prefer to search for wheelchair information on Android and iOS will now also be able to easily filter reviews focusing on wheelchair access.

Google made all of these announcements at this year’s I/O developer conference, where it also revealed that open source more code for Project Gameface’s hands-free “mouse”, allowing Android developers to use it in their apps. The tool allows users to control the cursor with head movements and facial gestures, so they can more easily use their computers and phones.

Stay up to date with all the news from Google I/O 2024 right here!

This article contains affiliate links; If you click this link and make a purchase, we may earn a commission.