Smartwatches could use ultrasound to sense hand gestures

Interaction designers love hand gestures. They're simple, generally pretty easy to learn, and intuitive. That makes them very handy for devices that lack sizeable screens, like smartwatches and other wearables.

But it's not simple to develop a foolproof way for a device to recognize those gestures. Accelerometers can help, but they're not very precise unless distinct and expansive gestures are made – which most users won't want to do in public.

Enter a team of researchers from the Bristol Interaction Group at the University of Bristol in the UK. They believe that ultrasonic imaging, as used in medicine and pregnancy scans, could hold the key to understanding hand movement.

By using a handheld ultrasound scanner and a collection of image processing algorithms and machine learning techniques, they were able to classify different muscle movements within the forearm as different gestures.

High recognition accuracy

In testing, the system showed high recognition accuracy and – importantly – the ability to deliver results while positioned at the wrist, which is handy because that tends to be where people wear smartwatches.

The only problem is that ultrasound devices are still somewhat large and bulky, meaning that a lot of miniaturization work will need to be done to develop a workable prototype.

"With current technologies, there are many practical issues that prevent a small, portable ultrasonic imaging sensor integrated into a smartwatch," said Jess McIntosh, a PhD student who worked on the research.

"Nevertheless, our research is a first step towards what could be the most accurate method for detecting hand gestures in smartwatches."

The team published its results in the Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 

Duncan Geere
Duncan Geere is TechRadar's science writer. Every day he finds the most interesting science news and explains why you should care. You can read more of his stories here, and you can find him on Twitter under the handle @duncangeere.
Latest in Smartwatches
Oura Ring 4
Activity tracking on Oura Ring is about to get a whole lot better, but I've got bad news about your step count
Google Pixel Watch 3, 41mm and 45mm
Google says it will fix broken Wear OS 5.1 update, but why does this keep happening?
Apple Watch Series 9 with Snoopy
Please, Apple, don't add a camera to the Apple Watch – it's not the change we're hoping for
Apple Watch Ultra 2 timer
The Apple Watch is getting a sleep alarm upgrade it probably should have had 10 years ago
Google Pixel Watch 3
Google Pixel Watches hit with delayed notifications, crashing, and performance issues following Wear OS 5.1 update
Apple Watch Ultra 2 move data
Apple is reportedly planning a huge future Apple Watch upgrade to turn it into an AI device with onboard cameras
Latest in News
Group of people meeting
Inflexible work policies are pushing tech workers to quit
A young woman is working on a laptop in a relaxed office space.
I’ll admit, Microsoft’s new Windows 11 update surprised me with its usefulness, providing accessibility fixes, a gamepad keyboard layout, and PC spec cards
Youtube
YouTube Premium could be getting a new time-saving perk, showing you recommended videos directly in your playback queue
inZOI promotional material.
inZOI has become the most wishlisted game on Steam, but I wouldn't get too caught up in the hype
Xbox Series X and Xbox wireless controller set to a green background
Xbox Insiders are currently testing a new Game Hub feature that looks useful, but I've got mixed feelings about it
A stylized depiction of a padlocked WiFi symbol sitting in the centre of an interlocking vault.
Broadcom warns of worrying security flaws affecting VMware tools