Google testing accessibility feature that will allow disabled users to control Android phone features with smiles, raised eyebrows and other facial gestures
- An update to Android 12 beta’s Android Accessibility Suite allows users to task gestures to scrolling forward, getting notifications, and other functions
- Users can select a combination of smiles, raising their eyebrows, opening their mouths, and eye glances
- The camera’s phone scans gestures and assigns them to an action of your choice
- You can control the sensitivity of the system to avoid accidental activation
- The feature could be useful for Android users with arthritis or other mobility issues that make hand gestures used on touchscreens difficult
Google is testing a new accessibility feature on Android phones that allows users to control functions by using facial gestures instead of touching its screen.
Part of the Android Accessibility Suite app, it allows users to connect an external device and control a number of functions, like ‘scroll forward,’ ‘scroll back,’ ‘home’ and ‘notifications.’
The update is intended to help people with disabilities, and who suffer from mobility issues which may make it harder for them to use a regular touch-screened device.
Users gestures are scanned by the phone’s camera and assigned to an action of their choice.
Right now the list of usable facial gestures includes ‘Open Mouth,’ ‘Smile,’ ‘Raise Eyebrows,’ ‘Look Left,’ ‘Look Right’ and ‘Look Up.’
An upgraded version of the ‘Camera’ Switch Access program was included as part of the Android 12 Beta 4 release, made available to Pixel phones on August 11, XDA Developers first reported.
Though the list is likely to grow, users in ‘Camera Switches’ mode can currently task a combination of gestures to perform the following functions:
- Pause Camera Switch
- Toggle auto-scan (disabled)
- Reverse auto-scan
- Select
- Next
- Previous
- Touch & hold
- Scroll forward
- Scroll backward
- Home
- Back
- Notifications
- Quick Settings
- Overview
The feature could be useful for Android phone users with Parkinson’s, arthritis, or other mobility issues that make the subtle hand gestures used on most smartphones difficult.
To limit accidental activations, you can adjust how sensitive the software is when recognizing expressions, The Verge reported, for example how wide you open your mouth or for how long.
Scroll down for video
A feature in the latest update to the Android Accessibility Suite app allows users to task certain functions to facial gestures, like smiling, opening their mouths, raising their eyebrows and looking up
The feature is power-intensive, however, and Google recommends phones be plugged in and charging while it’s being operated.
The upgrade is just the latest effort Google has made toward improved accessibility: In December 2020, it launched Look to Speak, an app that tracks eye movements to scan a list to find a desired phrase, which is then spoken aloud by an automated voice.
The app is aimed at people with speech and motor impairments and works when the front-facing camera on the smartphone has a clear view of the user’s eyes.
In October, it rolled out a feature for Android phones that notifies deaf users if there is an alarm going off, water running, a dog barking, or other ‘critical sounds,’ via push notifications, vibrations, or a flash from their camera light.
A user smiles (left) and raises their eyebrows for their Android phone ‘s camera, before tasking the gesture to one of any number of functions, like ‘scroll back,’ notifications,’ and ‘home.’ You can adjust how sensitive the software is, for example how wide you smile or for how long
The feature can benefit users with arthritis or other mobility issues that make fine manual gestures to operate a touchscreen difficult
While Google said Sound Notifications is designed for the estimated 466 million people in the world with hearing loss, it can also help people wearing headphones or otherwise distracted.
Developed with machine learning, it can alert users to up to ten noises—including baby noises, shouting, water running, smoke and fire alarms, sirens, appliances beeping, door knocking or a landline phone ringing.
In April 2020, Google introduced the ‘Talkback braille keyboard,’ a virtual keyboard that lets visually impaired users send messages and emails without additional hardware.
Right now the list of usable facial gestures includes ‘Open Mouth,’ ‘Smile,’ ‘Raise Eyebrows,’ ‘Look Left,’ ‘Look Right’ and ‘Look Up.’
Integrated directly into Android, ‘it’s a fast, convenient way to type on your phone. .. whether you’re posting on social media, responding to a text, or writing a brief email,’ the company said in a statement at the time.
In 2019, Google introduced two accessibility options: Live Transcribe, which turns speech into text in real time, and Sound Amplifier, designed to filter out ambient noise beyond the scope of a phone conversation.
HOW DOES GOOGLE MAP’S WHEELCHAIR ACCESSIBILITY FILTER WORK?
A Google Maps feature showing wheelchair accessible routes is now accessible in New York, Boston, Mexico City, Sydney, Tokyo, London and other cities.
To use, you must first enter you current location and destination.
Next, press ‘Directions’ and hit the public transportation icon to move to a screen that includes transport options.
On this page is a list of filters, including wheelchair accessible routes.
Google Maps feature highlights wheelchair accessible routes. The company says the feature will help disable people and parents who push strollers within public transportation hubs
‘When you select this option, Google Maps will show you a list of possible routes that take mobility needs into consideration,’ the company said in a statement in 2018.
But the option also benefits parents tasked with carrying strollers up and down stairs at transit stations and people who rely on crutches to get around.
The feature comes at a time when many transit authorities are receiving criticism for not creating better options for disabled people who rely on public transportation.
Source: Read Full Article