Android apps will soon let you use your face to control your cursor


Developers can now integrate the accessibility feature into their apps, allowing users to control the cursor with facial gestures or by moving their heads. For example, they can open their mouth to move the cursor or raise their eyebrows to click and drag.

Announced during last year’s Google I/O for desktop, Project Gameface uses the device’s camera and a database of facial expressions from MediaPipe’s Face Landmarks Detection API to manipulate the cursor.

“Through the device’s camera, it seamlessly tracks facial expressions and head movements, translating them into intuitive and personalized control,” Google explained in its announcement. “Developers can now build applications where their users can configure their experience by customizing facial expressions, gesture sizes, cursor speed, and more.”

While Gameface was initially made for gamers, Google says it has also partnered with Incluzza — a social enterprise in India focused on accessibility — to see how they can expand it to other settings like work, school, and social situations.

Project Gameface was inspired by quadriplegic video game streamer Lance Carr, who has muscular dystrophy. Carr collaborated with Google on the project, with the aim of creating a more affordable and accessible alternative to expensive head-tracking systems.

Source link


Please enter your comment!
Please enter your name here

Share post:




More like this

Russian playwright and director go on trial over ‘justifying terrorism’ | Courts News

Director Yevgeniya Berkovich and writer Svetlana Petriychuk were...

The Prognosis For PepGen (NASDAQ:PEPG)

About ~74,000 are affected in Europe,...

SeekOut, a recruiting startup last valued at $1.2 billion, lays off 30% of its workforce

SeekOut, an 8-year-old recruiting startup that uses AI...