Facebook researching advanced mobile AR and VR with full body tracking

If you've used an Oculus Rift headset, or sent a Facebook Messenger sticker, you'll be fully aware of Facebook's ambitions in both the virtual and augmented reality spheres. But new research shows it's still looking for new ways to impress in the areas where the digital and real worlds merge.

In a blog post, Facebook revealed that it is looking into ways it could not only overlay digital elements onto your face, but replace and track your entire body, whether in AR or VR scenarios.

“We recently developed a new technology that can accurately detect body poses and segment a person from their background. Our model is still in research phase at the moment, but it is only a few megabytes, and can run on smart phones in real time,” the researchers from Facebook's AI camera team explained.

Big ideas, low power

It's that last bit that's perhaps the most interesting element here – the fact that Facebook can get its body tracking tech to work with little memory, using only smartphone imaging and processing tech, is impressive.

It's not unique technology, but the efficiency is worth applauding, if it works consistently well. And the fact that Facebook is using neural networks to build on the reliability of the tracking means that, in time, it could continue to improve dramatically. 

With the team also hiring in this field, don't be surprised if you're soon sending full-body AR outfit clips to your pals through Facebook's apps.

Via: TechCrunch

Watch the video below to see what's new in the world of VR.

Gerald Lynch

Gerald is Editor-in-Chief of iMore.com. Previously he was the Executive Editor for TechRadar, taking care of the site's home cinema, gaming, smart home, entertainment and audio output. He loves gaming, but don't expect him to play with you unless your console is hooked up to a 4K HDR screen and a 7.1 surround system. Before TechRadar, Gerald was Editor of Gizmodo UK. He is also the author of 'Get Technology: Upgrade Your Future', published by Aurum Press.

Latest in Virtual Reality & Augmented Reality
Ray-Ban Meta Smart Glasses
Samsung's rumored smart specs may be launching before the end of 2025
Snap Spectacles 5
Latest Snap Spectacles update teases an exciting AR future that I can't wait for
Project Moohan prototype at Samsung Galaxy Unpacked, an XR goggles headset on display in a show area
Samsung's Android XR headset could avoid the Apple Vision Pro's biggest mistake, according to this leak
Vision Pro Metallica
Apple Vision Pro goes off to never never land with Metallica concert footage
The Ray-Ban Meta Coperni smart glasses
The new Ray-Ban Meta smart glasses design is an expensive disappointment
The Meta Quest Pro on its charging pad on a desk, in front of a window with the curtain closed
Samsung, Apple and Meta want to use OLED in their next VR headsets – but only Meta has a plan to make it cheap
Latest in News
Tesla Roadster 2
Tesla is still taking deposits on its long overdue Roadster, despite promising it would arrive in 2020
Samsung HW-Q990D soundbar with Halloween theme over the top
Samsung promises to repair soundbars bricked by its disastrous software update for free – but it'll probably involve shipping
Google Gemini AI
Gmail is adding a new Gemini AI tool to help smarten up your work emails
DJI Mavic 3 Pro
More DJI Mavic 4 Pro leaks seemingly reveal launch date, price and key features of the triple camera drone – here's what to expect
Android 16 logo on a phone
Here's how Android 16 will upgrade the screen unlocking process on your Pixel
Man sitting on sofa, drinking coffee, looking at phone in surprise
Thousands of coffee lovers warned to stop using their espresso machines immediately after reports of burns and lacerations