Android users will soon have Oh Miaccess to a revolutionarily accessible form of device control: Completely hands-free navigation, using the power of Google AI and facial tracking.
Part of the company's long list of updates and announcements rolling out at its developer keynote event today, the new feature is a mobile version of Google's desktop offering known as Project Gameface. The new virtual cursor uses Android accessibility services and a database of facial expressions from MediaPipe’s Face Landmarks Detection API to allow for broader customization and manipulation of hands-free tech for both users and developers.
SEE ALSO: Everything announced at Google I/O, including AI Agents, Ask Photos, and more"Through the device's camera, it seamlessly tracks facial expressions and head movements, translating them into intuitive and personalized control. Developers can now build applications where their users can configure their experience by customizing facial expressions, gesture sizes, cursor speed, and more," Google explained in its announcement.
Google partnered with international accessibility solutions group Incluzza to test the Gameface expansion in broader, non-gaming contexts, including work and social tasks.
Project Gameface first launched in 2023 as an open-source, hands-free gaming mouse allowing users to operate computer cursors with just head and facial movements. The technology was designed in collaboration with viral video game streamer Lance Carr, who is quadriplegic, as a more accessible option to expensive head-tracking systems. It also introduced the option of gesture size, allowing more customizability for users of different mobility.
"We’ve been delighted to see companies like playAbility utilize Project Gameface building blocks, like MediaPipe Blendshapes, in their inclusive software," Google wrote. "Now, we’re open sourcing more code for Project Gameface to help developers build Android applications to make every Android device more accessible."
Google also announced new AI features for its screenreader technology, TalkBack, which will provide more detailed descriptions and fill in information for unlabeled images on the web to help users who are blind or have low vision.
Project Gameface is now available for developers on GitHub.
Topics Android Google Social Good Accessibility
A Typical Wall Street Republican
The Uncertain Future of the American Mall
If I Had a Sense of Beauty
Eureka Moment: Ernest Hemingway, Sam Lipsyte, James Wright by The Paris Review
Best Apple deal: Save $19 on AirTag 4
Opera in a Post
Dominique Nabokov Photographs Artists’ Living Rooms
States of Desire: An Interview with Anne Garréta
The Baffler’s May Day Round Up
Why an Unemployed Actor Flew Across the Country to Stalk Salinger
NYT Connections Sports Edition hints and answers for May 18: Tips to solve Connections #237
The Uncertain Future of the American Mall
Why the Father of Modern Neuroscience Was Obsessed with Fiction
All This Blood and Love
Best vacuum mop combo deal: Save $140 on the Tineco Floor One S5
Reimagining Female Identity in a Ukrainian Orphanage
What Do We Do with the Art of Monstrous Men?
Black Friday, the Poem by Sadie Stein
Best Max streaming deal: Save 20% on annual subscriptions
Redux: James Baldwin, Raymond Carver, Dorothea Lasky by The Paris Review
Trump gets failing grade for Puerto Rico response from San Juan mayorWhere do you want to be in 6 months? Richard Branson wants to be in spaceCarmen Yulín Cruz and Whitefish fight over Puerto Rico contractNYT's The Mini crossword answers for March 14Trump's NOAA nominee signed weather deal with Chinese government'Apples Never Fall' review: Can this Liane Moriarty show top 'Big Little Lies?'Trump gets failing grade for Puerto Rico response from San Juan mayorStarbucks is shutting down its NFT rewards programPornhub just banned Texas. Here's why.These carbon fibre chairs are designed to be used on MarsHow to watch 'The Zone of Interest': Release date, streaming deals, and more.Kindle monthly deals: Get up to 80% off at AmazonDonald Trump threatens to take aid from Puerto Rico and, seriously, WTFWasp named after Lucius Malfoy just needs your love and understandingNYT's The Mini crossword answers for March 13Trump's NOAA nominee signed weather deal with Chinese governmentTrump's pick to lead environmental office really loves fossil fuelsHow to spot AIGoogle I/O 2024 date announcedApple Vision Pro may be coming to more countries soon Did George Lucas want Luke Skywalker to survive 'The Last Jedi'? Microsoft's new TOS prohibits 'offensive language' on Skype Superfan's 'Simpsons' 'Stranger Things' fans rejoice: Dad Steve will be back in Season 3 Nvidia unveils new Tesla V100 GPU, DG All the best protest signs from the March For Our Lives What's coming to (and going from) Netflix in April Football mascot's new name inspired by Lionel Messi is so punny it hurts We asked astronauts if they think aliens exist. Here's what they said Researchers discover mummy in coffin thought to be empty Mozilla releases anti New plan would pay your deposit back if you return your drinks containers Facebook's Cambridge Analytica scandal paves way for data changes 'Lego The Incredibles' makes family team There's an extremely relatable hidden message in 'Isle of Dogs' Dude escapes from jail Indiana Jones style by ducking under a closing door Arizona orders Uber to stop testing self FTC confirms it’s investigating Facebook — a huge threat to the social media giant America's youth finally destroyed slacktivism 10 life lessons from 'Mister Rogers' Neighborhood'