Facebook wants you to look more realistic in virtual reality

Facebook VR avatars

The progression in how users are represented in virtual reality (VR) has come a long way since the floating blue blobs of those early days, but Facebook wants it to go even further. 

During the Day 2 keynote at F8 2018, Facebook CTO Mike Schroepfer took a few minutes to discuss how the company is working to develop ever-more realistic VR avatars, which represent users when using products like Oculus Rift and Oculus Go

One area where Facebook has improved is in mouth tracking, helped along by advancements in the company's artificial intelligence (AI) and VR technologies. 

By more closely matching the actual mouth movements of users when they're speaking, the digitally rendered avatars appear more life-like.

But, Schroepfer noted, avatars still aren't indistinguishable from reality, and to that end he said Facebook is working on photo-realistic renderings of users that take place in real-time thanks to AI. 

As you can see in the image above, Facebook's cartoony avatars are replaced by much more realistic representations, though there's still something computerized about the renderings that keep them from looking truly life-like. 

Crucially, though, these new avatars could pick up on expressions that cartoons simply can't, allowing users to not only express themselves more accurately in a VR space, but allow for deeper connections with other users. 

Of course, go too far into photo-realism, and you enter uncanny valley territory, so it's a fine line Facebook will have to walk as it looks to create avatars that more accurately represent its VR users. 

Schroepfer did note this work is still in the early stages, so we're likely a ways off before photo-realistic avatars start popping up in experiences Oculus Rooms and Facebook Spaces.  

Project Santa Cruz-in'

Schroepfer also offered a quick tease of one of the most intriguing products in the Facebook and Oculus roadmap: Project Santa Cruz

Schroepfer said the wireless, standalone headset is in the hands of third-party developers right now and that Facebook will have "exciting updates" to share later this year. 

Project Santa Cruz doesn't require a PC to operate

Project Santa Cruz doesn't require a PC to operate

He left it at that, but the timing of "later this year" would line up with the Oculus Connect conference, which usually takes place in October. 

It wouldn't surprise us at all to see a final version of Project Santa Cruz unveiled then, and possibly have the headset go on sale at that time. 

We tried Project Santa Cruz (likely a codename) at last year's Oculus Connect and were impressed with its ability to track you around a room and its lack of a wire. This allowed near-total freedom of movement without a major drop-off in the quality of the experience. 

The standalone Oculus Go just went on sale, and while it offers affordable and accessible VR, we've still got our eyes on Project Santa Cruz and the VR experience it promises to offer. 

TOPICS
Michelle Fitzsimmons

Michelle was previously a news editor at TechRadar, leading consumer tech news and reviews. Michelle is now a Content Strategist at Facebook.  A versatile, highly effective content writer and skilled editor with a keen eye for detail, Michelle is a collaborative problem solver and covered everything from smartwatches and microprocessors to VR and self-driving cars.

Latest in Virtual Reality & Augmented Reality
Project Moohan prototype at Samsung Galaxy Unpacked, an XR goggles headset on display in a show area
Samsung's Android XR headset could avoid the Apple Vision Pro's biggest mistake, according to this leak
Vision Pro Metallica
Apple Vision Pro goes off to never never land with Metallica concert footage
The Ray-Ban Meta Coperni smart glasses
The new Ray-Ban Meta smart glasses design is an expensive disappointment
The Meta Quest Pro on its charging pad on a desk, in front of a window with the curtain closed
Samsung, Apple and Meta want to use OLED in their next VR headsets – but only Meta has a plan to make it cheap
The new limited edition Ray-Ban Meta smart glasses show a translucent design.
Ray-Ban and Meta just teased new limited-edition smart glasses – but they'll be in frustratingly short supply
The Meta Aria Gen 2 with its sensors exploding out from the frame
Meta's new smart glasses come with some much-needed upgrades to their battery and sensors
Latest in News
A super close up image of the Google Gemini app in the Play Store
It's official: Google Assistant will be retired for phones this year, with Gemini taking over
Quordle on a smartphone held in a hand
Quordle hints and answers for Sunday, March 16 (game #1147)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Sunday, March 16 (game #378)
NYT Connections homescreen on a phone, on a purple background
NYT Connections hints and answers for Sunday, March 16 (game #644)
Three iPhone 16 handsets on show
Apple could launch an iPhone 17 Ultra this year – but we've heard these rumors before
Super Mario Odyssey
ChatGPT is the ultimate gaming tool - here's 4 ways you can use AI to help with your next playthrough