Apple plans Minority Report-style user interface

Apple's new touch-surface UI will allow users to control basic computer functions like text input, scrolling and pointing with hand gestures and movements

An 80-page patent application picked up on by Appleinsider reveals how Apple is working on the development of an advanced touch-surface user interface system that could eventually do away with the traditional keyboard and mouse combo.

According to the patent, the device is envisaged as an ergonomic, keyless board that the user is able to comfortably rest both hands on. Apple has placed a lot of emphasis on user comfort and the avoidance of any overly arduous or repetitive actions that could lead to strains or RSI. In keeping with all Apple products, it’s designed, above all, to be user friendly.

Handwriting detection

From the main position of two hands resting on the surface, users will be able to control basic computer functions like text input, scrolling and pointing with a range of simple hand gestures and movements. The patent claims that the user should be able to switch seamlessly between different input methods.

There’s also talk of an advanced “pen grip detection module” to facilitate handwriting detection. If our reading of things is correct then the surface would be able to sense the minute movements from the inner fingers of the writing hand and interpret them as characters.

Furthermore, the sensor network underpinning the device would be able to see things in three-dimensions, enabling it to detect tilt and roll and how much pressure is being applied. This would aid handwriting recognition immensely, and could also have some interesting applications for the manipulation of three-dimensional environments.

Fingerworks' touch-screen tech

Much of what is contained in the patent is attributed to Wayne Westerman of Fingerworks – a company specialising in touch-screen technology that was acquired by Apple in 2005.

Initially brought on board to help implement the iPhone’s UI, Fingerworks was also behind a number of the multi-touch trackpad innovations revealed in a similar Apple patent application last week.

TOPICS
Latest in Keyboards
The Satechi SM3 mechanical keyboard against a blue background.
I used the Satechi SM3 Slim Mechanical Backlit Bluetooth Keyboard and was surprised by how light it is for a full-sized board
Corsair K70 Pro TKL gaming keyboard resting on a desk
I replaced my main gaming keyboard with the Corsair K70 Pro TKL for two weeks - here's my verdict
The Asus ROG Falchion Ace HFX keyboard
I’ve fallen in love with the Asus ROG Falchion Ace HFX 65% keyboard because of its brilliant touch bar and Hall effect keys
Logitech G915 X on desk with plant and pink wall in background
I spent several days with the Logitech G915 X Lightspeed TKL, and while it’s capable enough, it doesn’t best its rivals
black gaming keyboard against red background
Take $100 off one of the best Logitech gaming keyboards just in time for Presidents' Day
Lemokey L5 HE 8K on table with pink wall and plant in background
I tested the new Lemokey L5 HE 8K and while it offers plenty of analog adjustments, it doesn’t feel quite as good as its rivals
Latest in News
Nintendo Switch 2 Joy-Con up-close from app store
Nintendo's new app gave us another look at the Switch 2, and there's something different with the Joy-Con
cheap Nintendo Switch game deals sales
Nintendo didn't anticipate that Mario Kart 8 Deluxe was 'going to be the juggernaut' for the Nintendo Switch when it was ported to the console, according to former employees
Three angles of the Apple MacBook Air 15-inch M4 laptop above a desk
Apple MacBook Air 15-inch (M4) review roundup – should you buy Apple's new lightweight laptop?
Witchbrook
Witchbrook, the life-sim I've been waiting years for, finally has a release window and it's sooner than you think
Amazon Echo Smart Speaker
Amazon is experimenting with renaming Echo speakers to Alexa speakers, and it's about time
Shigeru Miyamoto presents Nintendo Today app
Nintendo Today smartphone app is out now on iOS and Android devices – and here's what it does