Beyond the mouse: how input is evolving

Movement
Our movement is becoming ever more crucial to data input

The arguments about interfaces might still be going on, but the touchscreen has won.

If Windows 8 isn't rushing off the shelves, at least some of the blame belongs to how few PC makers believed Microsoft when it said buyers would want a notebook with a touchscreen. All Haswell Ultrabooks will have touchscreens when they launch in a few months.

Even the Chromebook Pixel has a touchscreen (leaving the Mac as the last holdout). We're hoping some tablet or makers pick up Synaptic's touchscreen that sees when your thumb is on the screen and reflows text around it so you can read it.

Reflow

Text on a touchscreen, getting out of the way of your thumb

That's this year though; in the future, we're going to control out systems with a flick of the wrist, a roll of the eye or even by thinking at them - and yes, by shouting a bit as well. The technologies to give us interfaces that feel more natural than mouse, keyboard and touchscreen are on the way.

Just smile and wave

Voice interfaces aren't new; we've been dictating documents and shouting at automated phone systems for years. Until voice-driven Google Glass arrives, Siri in iOS and voice recognition in Kinect for controlling Xbox are about the state of the art.

Intel is trying to move that on by including Nuance's Voice Assistant in the 'perceptual computing' kit it's seeding developers with. We're going to see voice in home entertainment systems as well; Voco showed off voice control for iOS and Android apps that let you search for the track you want to hear on its multi-room music streaming players. The hard part is getting unusual music names correct; the system gets 50 Cent but not Florence + the Machine.

There are issues with talking to technology from background noise to strange looks from those around you. How about just looking at it? MIT spinout Affectiva can already measure your emotional reaction to adverts by scanning your micro expressions through your webcam; you might say you didn't find the Samsung advert mocking iPhone users standing in line funny, but the Affdex system could tell if you were smiling when you watched it or not even paying attention.

More useful and less creepy is Tobii's gaze tracking system which works alongside your mouse and keyboard. Want to zoom in on a map? Instead of painstakingly centring it on screen before you click to zoom in (and then dragging it back to the right place), when we tried out the Tobii prototype at CES this year the map automatically zoomed in on the area we were looking at.

We were also able to control a PowerPoint presentation, flicking back and forth between slides (and to blow up a few asteroids in a game). Using your eyes doesn't replace the mouse or keyboard; it's the combination that works so well. Think of all the times you forget to click on the document you're looking at and end up typing into the last window you were using.

This Tobii prototype will end up small enough to fit in a laptop screen

This Tobii prototype will end up small enough to fit in a laptop screen

Tobii will turn its prototype into a peripheral you can buy by the end of 2013, but the developers are sure they can make it much smaller and they're talking to OEMs about building it right into a monitor or even a laptop.

Kinect-style gestures are on their way to laptops as well, although probably not using the pricey 3d infrared cameras in Kinect or Intel's USB 3D camera for developer just yet (although we quite like Intel's idea of using a 3D camera and muscle movements to replace passwords with combined facial and voice recognition.)

Those sensors cost about $70 according to Amnon Shenfeld of eyesight; the CMOS sensors in Webcams cost more like $1 – cheap enough to put two of them in a laptop to use for gesture tracking. Like the human eye, having two sensors means you can get an approximation of 3D; good enough for gestures.

Contributor

Mary (Twitter, Google+, website) started her career at Future Publishing, saw the AOL meltdown first hand the first time around when she ran the AOL UK computing channel, and she's been a freelance tech writer for over a decade. She's used every version of Windows and Office released, and every smartphone too, but she's still looking for the perfect tablet. Yes, she really does have USB earrings.

Latest in Mice
Two examples of the Asus Fragrance Mouse MD101 sitting on a table
Your next computer mouse could have a fragrance compartment for aromatherapy oils – and this Asus idea is nothing to sniff at
The Asus ROG Harpe Ace Mini gaming mouse on a table
The Asus ROG Harpe Ace Mini might be small, but few mice have impressed me this much
Logitech POP on plinth with pink and plant in background
I love the feel of the Logitech POP Mouse, but it does miss out on a few features
Cherry XTRFY M64 Wireless on table with pink background and plant
The Cherry XTRFY M64 Wireless fits my hand like a glove, but I'm not sure it's the best value gaming mouse around
The Razer Basilisk V3 Pro 35K gaming mouse against a blue background.
Razer Basilisk V3 Pro 35K: Everyday excellence
MSI Clutch GM41 Lightweight V2 on desk
MSI Clutch GM41 Lightweight V2 review: a basic, lightweight gaming mouse that doesn’t quite live up to its potential
Latest in News
Microsoft
"Another pair of eyes" - Microsoft launches all-new Security Copilot Agents to give security teams the upper hand
Cassian Andor looking nervously over his shoulder in Andor season 2
New Andor season 2 trailer has got Star Wars fans asking the same question – and it includes an ominous call back to Rogue One's official teaser
Ncuti Gatwa as The Fifteenth Doctor in Doctor Who
Disney+ drops new trailer for Doctor Who season 2 that promises an epic adventure across time and space
23andMe
23andMe is bankrupt and about to sell your DNA, here's how to stop that from happening
A phone showing a ChatGPT app error message
ChatGPT was down for many – here's what happened
AirPods Max with USB-C in every color
Apple's AirPods Max with USB-C will get lossless audio in April, but you'll need to go wired