This Apple AR patent could turn any surface into a touchscreen

Apple Glass - Apple logo seen through a pair of glasses
(Image credit: Shutterstock / Girts Ragelis)

An Apple patent has demonstrated how the tech giant could combine augmented reality with thermal technology to generate a virtual touchscreen on practically any surface, making use of thermal cameras built into a potential AR glasses device.

Spotted by Patently Apple, the technology known as Thermal Touch was developed by tech company Metaio, which Apple acquired back in 2015. Put as simply as possible, the technology combines information drawn from infrared sensors with an AR display to generate a workable touchscreen.

Thermal Touch recognizes the heat generated from touching a surface, and registers that as a command, making the virtual interface interactive. Projected applications could come in the form of virtual keyboards or potentially full touchscreen displays if Apple’s rumored AR glasses are powerful enough to handle the processing required.

The magic touch

In the above video released in 2014, prior to Apple’s acquisition of the company, Metaio CEO Dr. Thomas Alt explains potential applications of Thermal Touch technology, and that “the world” can become a touchscreen as a result. A major – and impressive – example shown involves a user touching an image of a jacket in a magazine to produce shopping results.

Other interesting examples shown in the video include a fully virtual chess game, with individual pieces recognizing – and being able to be moved by – Thermal Touch input. It was perhaps Metaio’s working prototype that caught Apple’s attention in the first place.

We can assume that Apple and Metaio have been developing Thermal Touch technology for some time, then, and we’ve seen lots of eyebrow-raising rumors surrounding Apple’s AR smartglasses, from generating virtual objects to compatibility with haptic socks. Yes, you read that right.

While this is all still largely based in conjecture, the steady trickle of rumors and patent reveals show that Apple’s development in augmented reality could be quite a leap forward for the nascent technology. Analysts suggest that the glasses could go to market as early as 2022.

TOPICS
Rhys Wood
Hardware Editor

Rhys is TRG's Hardware Editor, and has been part of the TechRadar team for more than two years. Particularly passionate about high-quality third-party controllers and headsets, as well as the latest and greatest in fight sticks and VR, Rhys strives to provide easy-to-read, informative coverage on gaming hardware of all kinds. As for the games themselves, Rhys is especially keen on fighting and racing games, as well as soulslikes and RPGs.

Read more
Apple AirPods Pro in someone's hand
Future AirPods Pro could swap the touch-sensing swipe control for something smarter, and it sounds like a great upgrade
If the iPhone 17 gets this rumored Face ID upgrade, I'll never call Apple unoriginal again
Apple Watch foldable display patent
Forget the folding iPhone – Apple has patented a foldable Apple Watch with two screens
Apple Glass - Apple logo seen through a pair of glasses
Report: Apple is stopping work on a pair of smart glasses that would have connected to the Mac
The Nanoleaf PC Screen Mirror Lightstrip being used on a desktop computer.
Mac gaming could get an intriguing boost – but not in the way you'd expect
The Samsung Galaxy Ring in Titanium Silver
A future Samsung Galaxy Ring could have a feature to stop you burning yourself on your morning coffee
Latest in Tech
A Lego Pikachu tail next to a Pebble OS watch and a screenshot of Assassin's Creed Shadow
ICYMI: the week's 7 biggest tech stories from LG's excellent new OLED TV to our Assassin's Creed Shadow review
A triptych image of the Meridian Ellipse, LG C5 and Xiaomi 15.
5 amazing tech reviews of the week: LG's latest OLED TV is the best you can buy and Xiaomi's seriously powerful new phone
Beats Studio Pro Wireless Noise Cancelling Headphones in Black and Gold on yellow background with big savings text
The best Beats headphones you can buy drop to $169.99 at Best Buy's Tech Fest sale
Ray-Ban smart glasses with the Cpperni logo, an LED array, and a MacBook Air with M4 next to ecah other.
ICYMI: the week's 7 biggest tech stories from Twitter's massive outage to iRobot's impressive new Roombas
A triptych image featuring the Sennheiser HD 505, Apple iPad Air 11-inch (2025), and Apple MacBook Air 15-inch (M4).
5 unmissable tech reviews of the week: why the MacBook Air (M4) should be your next laptop and the best sounding OLED TV ever
Apple iPhone 16e
Which affordable phone wins the mid-range race: the iPhone 16e, Nothing 3a, or Samsung Galaxy A56? Our latest podcast tells all
Latest in News
Quordle on a smartphone held in a hand
Quordle hints and answers for Sunday, March 23 (game #1154)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Sunday, March 23 (game #385)
NYT Connections homescreen on a phone, on a purple background
NYT Connections hints and answers for Sunday, March 23 (game #651)
Google Pixel 9 Pro Fold main display opened
Apple is rumored to be prioritizing battery life on the foldable iPhone – which could also feature a liquid metal hinge for added durability
Google Pixel 9
The Google Pixel 10 just showed up in Android code – and may come with a useful speed boost
L-mount alliance
Sirui joins L-Mount Alliance to deliver its superb budget lenses for Leica, DJI, Sigma and Panasonic cameras