How 3D video chat and sound is shaping up

3D entertainment
3D is currently driving a revolution in home entertainment, but what does the future really hold?

When talking about the prospect of 3D telephony, it's easy to get distracted by the newest 3D phones like the HTC Evo 3D and the LG Optimus 3D. However, while impressive, these devices don't let you make calls in 3D. What are the odds of

3D

video chat happening?

When (if ever) will we be able to recreate that famous scene from Star Wars in which R2-D2 plays Princess Leia's holographic voicemail message? Disappointingly, we're a long way from being able to beam 3D video from pico projectors in our phones or laptops, but the technology exists.

Scientists at the University of Arizona in Tucson have created a system to capture a 3D image and transmit it (in near real time) anywhere in the world. According to Nature journal's website, the team's system "captures 3D information by filming an object from multiple angles, using 16 cameras that each take an image of the object every second. The 16 views are processed into holographic pixel data by a computer."

The resulting three-dimensional holograms are small and slow, but you could have one in your home by 2020. Can't wait that long? Video conferencing specialist TrueConf has developed a 3D version of its popular business software, which can broadcast a 3D video stream thanks to twin cameras mounted on PC monitors. Conference participants need to don Nvidia 3D shutter glasses to get the full effect. TrueConf 3D will be available late 2011 with a price tag of $5,000 (around £3,000).

3D sound

3D sound

Think that surround sound is 3D sound? Think again. While traditional 5.1 and 7.1 speaker setups can produce a rich soundstage, the audio is mixed to conform to specific channels and speaker placements. The closest you'll get is sitting in the sweet spot of an 11.1 system, which consists of five front speakers (two of them at height), four side speakers, two rear speakers and a subwoofer. It's not ideal for most homes.

What we really need is a virtual solution, and Edgar Choueiri, Professor of Physics at Princeton University, is close to giving us one. Disappointed with the realism of traditional surround sound systems, Choueiri developed an audio filter that works with standard stereo speakers.

"With 3D audio, I can get a fly to go around your head," he told the BBC's Today programme. "Or if you want to really scare somebody, you can put a sound inside their head."

Professor Choueiri's work has the potential to revolutionise home audio, and he has recently formed a partnership with Cambridge Mechatronix (CML) to develop the Dynasonix 3D sound system.

According to CML, the technology works by focusing a pair of sound beams on each of several listeners' ears, tracking their positions in realtime with a camera and delivering cross-talk cancelled 3D audio to each listener. As a result, each listener gets their own individual sound field.

"This gives you a comparable sound experience to headphones, but without the headphones," says CML.

When 3D goes wrong…

Autostereograms

Autostereograms

What do you do when you want 3D without glasses, but you can't simply project a 3D image? If you're sensible, you wait 20 years for technology to catch up with your plans. If not, you ask people to squint until patterns of dots coalesce into shapes at around 30 frames per second.

This is how 3D was simulated in Magic Carpet, a game from 1994, and if you could play it like that, you deserved a prize. That prize: a lifetime supply of paracetamol for the headaches you'd soon be all too familiar with. Most players soon gave up and returned to the regular 2D graphics, and not without cause.

Virtual reality

VR

The concept was brilliant - a helmet that puts screens up to your eyes, immersing you in a full 3D world. The downsides? Heavy equipment, nausea from having no actual sensation of movement, and very primitive computers handling the grunt work.

The most common VR machines, found in arcades in the early '90s, were powered by an Amiga 3000, and were too limited to be anything but a novelty. Several attempts were made to reignite the concept, but with the intrusive nature of even the slimmest headsets and little to no actual software support, they never caught on.

Virtual Boy

Virtualboy

The first major 3D games console to hit the market was also the last until this year, when Nintendo launched the 3DS. Being too big and heavy to be portable, too loud to be ignored, and with practically no games support would have been a killer for any system, but the Virtual Boy went one step further by only using a single colour in its graphics, and that colour was red.

Rarely has a system been so painful to use for any length of time, or so badly conceived. It lasted a single year on the shelves, but retains its reputation as one of the worst consoles ever created.

VRML

VRML

The problem with the Virtual Reality Markup Language wasn't simply that it was slow and unimpressive, but that its supporters misjudged what the internet would be. VRML was the language of cyberspace, where we'd walk around a web of 3D mansions and supermarkets, recreating interactions in a virtual context.

Instead, the world realised that clicking on hypertext was easier, and cheaper. After attempting to convince everyone otherwise, the software industry saw sense and surrendered.

Ecstatica

Ecstatica

Most games are built around triangular polygons because they're what 3D accelerator cards were originally built to use. There have been other technologies over the years, including voxels (pixels with depth, originally used to create landscapes in games like Commanche, and which can still be seen in games today) and the hilarity that was ellipsoid-based modelling.

This began and largely ended with Ecstatica and its sequel; two horror games full of torture and Satanic plotting (rated 18) rendered hilarious by being, quite literally, a load of balls.

3D controllers

Power glove

There have been a few brave attempts to create 3D alternatives to the keyboard and mouse. Mostly, these have failed for two reasons: it can be very tiring to have your hands constantly hovering or gripping a controller, and even if the technology is up to scratch (unlike the Power Glove, above, which used ultrasonic sound to detect its position), there's no haptic element to help you sense items in the space.

Add in a tendency to be imprecise yet unforgiving, and it's no surprise that the keyboard and mouse are still the tools of choice.

Latest in Entertainment
This City Is Ours
How to watch This City Is Ours online – stream Sean Bean crime drama from anywhere
Canada's Val Sweeting competes during the LGT World Womens Curling Championship match for third place ahead of Canada's showing at the Women's Curling World Championships 2025
Women's Curling World Championships live stream: how to watch Uijeongbu 2025 online, schedule, streaming guide
Star Wars BDX Droids walking in Galaxy's Edge.
‘We only build technology in the interest of storytelling’ – Disney’s associate lab director of Robotics on the Star Wars BDX Droids and what lies ahead
Thomas Tuchel, Head Coach of England, reacts during a training session at St George's Park on March 17, 2025 in Burton upon Trent, England.
England vs Albania live stream: How to watch 2026 World Cup qualifier online and from anywhere today, team news
A collage of Eve Macarro in Ballerina and John Wick in his third film
New Ballerina movie trailer suggests Keanu Reeves' John Wick will have a bigger role to play in the spin-off film than we thought
McLaren’s Oscar Piastri driving on a straight in qualifying for the Chinese Grand Prix 2025
How to watch Chinese Grand Prix 2025: TV & live streams, schedule, start time, what channel is it on? Piastri on pole
Latest in News
Zendesk Relate 2025
Zendesk Relate 2025 - everything you need to know as the event unfolds
Disney Plus logo with popcorn
You can finally tell Disney+ to stop bugging you about that terrible Marvel show you regret starting
Google Gemini AI
Gemini can now see your screen and judge your tabs
Girl wearing Meta Quest 3 headset interacting with a jungle playset
Latest Meta Quest 3 software beta teases a major design overhaul and VR screen sharing – and I need these updates now
Philips Hue
Philips Hue might be working on a video doorbell, and according to a new report, we just got our first look at it
Microsoft
"Another pair of eyes" - Microsoft launches all-new Security Copilot Agents to give security teams the upper hand