Apple VR headset could turn your fingers into holographic controllers

VR headset
(Image credit: Mark Nazh / Shutterstock)

Apple has been granted a patent relating to the 3D modeling of fingers for in-air gesture recognition – suggesting this could be a feature of the upcoming Apple VR headset.

The patent, published by the US Patent & Trademark Office, details a system capable of generating a 3D model of fingers to be used to navigate virtual environments.

It’s worth noting that this technology relates to Apple’s rumored VR headset project, rather than its in-development Apple Glasses, and therefore substantiates claims made by various sources that the headset could arrive as early as 2022.

The patent refers to both finger gestures and visual touch detection, with figure images outlining how the system might work.  

Apple VR patent

(Image credit: US Trademark and Patent Office)

In the above image, for example, a diagram illustrates a potential system setup for generating a 3D model of a fingertip using a combination of cameras and depth sensors. Accompanying text also references contour alignment-based algorithms that could be used to enable hand tracking.

While this approach to finger tracking may be new, the actual result sounds similar to the tracking software we’ve seen in existing VR headsets, like the Oculus Quest 2.

Of course, these Apple-patented systems are likely in the early stages of development, but they nonetheless offer an exciting glimpse at what to expect from the company’s inaugural VR headset – whenever it arrives. 

What else do we know?

As for further details on Apple’s flagship VR project, it’s a mixture of conjecture and well-advised rumors at this point.

We’ve heard mutterings regarding possible dual 8K displays, eye-tracking software and LiDAR scanning sensors on the headset, as well as wearable haptic controllers that might serve to complement the 3D modeling software detailed above.

In addition to features, though, we’ve also heard some less-than-exciting rumors regarding the price of Apple’s VR headset. While an official figure has, of course, not yet been confirmed, a report by The Information has the device priced at an eye-watering $3,000. 

That’s a number that’s been corroborated by Bloomberg sources, who claim Apple is expecting the VR headset to sell roughly one unit per store per day. 

So, the bottom line: Apple’s VR headset is almost certainly on its way – you just might need to start saving now to get your hands on one.

Stay tuned to TechRadar for our coverage of WWDC 2021 (Apple’s annual Worldwide Developers Conference) in June, where we might get some more official information regarding the company’s coveted VR project.

Via Patently Apple 

TOPICS
Axel Metz
Phones Editor

Axel is TechRadar's UK-based Phones Editor, reporting on everything from the latest Apple developments to newest AI breakthroughs as part of the site's Mobile Computing vertical. Having previously written for publications including Esquire and FourFourTwo, Axel is well-versed in the applications of technology beyond the desktop, and his coverage extends from general reporting and analysis to in-depth interviews and opinion.  Axel studied for a degree in English Literature at the University of Warwick before joining TechRadar in 2020, where he then earned an NCTJ qualification as part of the company’s inaugural digital training scheme.

Read more
Project Moohan prototype at Samsung Galaxy Unpacked, an XR goggles headset on display in a show area
Samsung's Android XR headset could avoid the Apple Vision Pro's biggest mistake, according to this leak
If the iPhone 17 gets this rumored Face ID upgrade, I'll never call Apple unoriginal again
Google Android XR, Glasses, and Project Moohan
Samsung Project Moohan: the latest news for the Android XR headset
Apple AirPods Pro in someone's hand
Future AirPods Pro could swap the touch-sensing swipe control for something smarter, and it sounds like a great upgrade
The Meta Quest 3 and controllers on their charging station which is itself on a wooden desk next to a lamp
Forget Android XR, I've got my eyes on Vivo's new Meta Quest 3 competitor as it could be the most important VR headset of 2025
The Meta Quest Pro on its charging pad on a desk, in front of a window with the curtain closed
Samsung, Apple and Meta want to use OLED in their next VR headsets – but only Meta has a plan to make it cheap
Latest in Virtual Reality Gaming
Hitman's Agent 47 strangling someone while dressed as a sailor
‘Never say never’ – we ask Hitman developer if Project 007 is coming to VR, and learn how Hitman VR was fixed for PSVR 2
Agent 47 holding up duel pistols with a PSVR 2 headset outline over his head
I can’t believe it either, Hitman on PSVR 2 is actually, finally a great VR port of the World of Assassination trilogy – and my new favorite way to play the series
Meta Quest 3 in white with Batman: Arkham Shadow bundle on red background with don't miss text
Get a $50 gift card with this Meta Quest 3 + Batman Arkham Shadow bundle at Best Buy
A Dragonborn warrior, Tiefling rogue and Halfling mage preparing for battle next to a sign saying "Demeo x Dungeons & Dragons: Battlemarked"
First Dungeons & Dragons VR trailer teases a beginner-friendly tabletop game – but I’m just begging for a custom game mode
Meta Quest 3S with Batman: Arkham Shadow banner behind it and red background with black TechRadar lowest price sign
Save $50 on the Meta Quest 3S with a free copy of Batman: Arkham Shadow
Aliens crawl out of the dark to attack Zula
Alien: Rogue Incursion review: superb survival horror with monsters I wish were more terrifying
Latest in News
Three angles of the Apple MacBook Air 15-inch M4 laptop above a desk
Apple MacBook Air 15-inch (M4) review roundup – should you buy Apple's new lightweight laptop?
Witchbrook
Witchbrook, the life-sim I've been waiting years for, finally has a release window and it's sooner than you think
Amazon Echo Smart Speaker
Amazon is experimenting with renaming Echo speakers to Alexa Devices, and it's about time
Shigeru Miyamoto presents Nintendo Today app
Nintendo Today smartphone app is out now on iOS and Android devices – and here's what it does
Nintendo Virtual Game Card
Nintendo reveals the new Virtual Game Card feature, an easier way to manage your digital Switch games
Isometric demonstrating multi-factor authentication using a mobile device.
NCSC gets influencers to sing the praises of 2FA