Skip to main content

Google Develops App to Enable Persons with Motor Impairment Communicate with Eye-gaze Technology

December 09, 2020

Google, together with speech and language therapist Richard Cave, has developed an experimental Android app designed to provide people living with speech and motor impairments, particularly those who are non-verbal and require communication assistance, with a way to express themselves.

Look to Speak uses machine learning and eye gaze technology that lets people use their eyes to look left, right, or up to select from a list of phrases for their phone to speak out loud. The app can also be used to snooze the screen and edit a user's phrase book.

Some of the phrases include: Hello, thank you, yes, and no.

"As mobile devices become more ubiquitous and powerful, with technologies like machine learning built right into them, I've thought about the ways phones can work alongside assistive technologies. Together, these tools can open up new possibilities -- especially for people around the world who might now have access to this technology for the very first time," Cave wrote in a blog post.

Cave believes Look to Speak could be used as an extension to existing eye gazing technology.

"We're not replacing all of this kind of heavy-duty communication aid stuff because there's a lot of functionality in there. Look to Speak is for those important short messages where the other communication device can't go," he said.

Elsewhere within Google, work is being carried out to help users overcome the challenge of accessing payment information and passwords stored in their Google Account when using Chrome in situations where sync is not turned on.

Chrome product manager Sabine Borsay said in a blog post that "over the coming weeks and months" Google would ensure payments and password management are available to all signed-in users, syncing or not.

Borsay outlined Chrome on Android would allow users when they sign in to Google services, such as Gmail, to sign in to Chrome using their Google Accounts with a single tap, even when using sync, thereby avoiding the need to re-enter credentials.

Using this new sign-in method, according to Borsay, will allow users to autofill payment methods stored in their Google Account, as well as save a new credit card to the account to be used across all devices.

"We've heard your feedback for more flexibility when it comes to having access to passwords saved to your Google Account. Over the next couple of months, accessing and managing your passwords safely across your devices will become even easier," Borsay said.

"This can all be done simply by signing in to your Google Account, regardless of whether sync is enabled. You'll be able to autofill passwords on sites that you previously saved to your account, and when you save a new password, Chrome will let you choose where you want to save it -- on the device or in your Google Account. If you choose your account, you can access it on all your devices."

Source: ZD Net

Related Information

Google Mobile App Motor Impairment