How Weta changed motion capture tech for Dawn of the Planet of the Apes

Weta Digital mocap apes feature

This development allowed the team to mo-cap on set, instead of limiting the filming to the studio in New Zealand.

The battery pack attached to the active mo-cap suit lasted for 2-3 hours, but with the stop/start nature of filming, they replaced the battery packs between takes.

Given the nature of the shooting location for Dawn of the Planet of the Apes in the Canadian rainforest, the Weta team had to create a way to not only condense their setup into a relatively compact solution for easy transport, but also work out how to make the setup waterproof.

"On set, rather than having tens of hours to set everything up and calibrate, we have tens of minutes. We basically have to be able to build the thing really quickly and make adjustments as things change as we're shooting the film," explained Dan Lemmon, Visual Effects supervisor at Weta.

"So we've developed equipment and methodology for having fewer of the cameras to start with and being able to quickly set them up and aim them around and not have so many cables. We've got some new techniques to be able to attach them to places that aren't necessarily very accessible and in some cases are a little dangerous," Lemmon added.

Weta Digital mocap apes feature

The crew managed to get everything they needed stored into three road cases similar to those used by touring musicians. They also became adept at setting up the capture equipment quickly, as the nature of shooting on location didn't leave a lot of time to stuff around with fine-tuning cameras.

All about the performance

Of course, there's more to the motion capture than just super-tight lycra and fancy infrared cameras.

These days, it's probably more correct to call the technology "performance capture", as it is a lot more about translating an actor's performance.

During the motion capture for the Apes film, the actors walked around on short crutch-like arm extensions and trained moving like apes to try and mimic how chimps and gorillas move in the real world. Movement is obviously important in capturing believability, but more important is the nuanced performance of the actor.

To capture that nuance, there's a huge emphasis on the actor's face. For a large number of scenes during filming, the actors wore special helmets with mounted cameras that recorded every minute facial expression.

Weta Digital mocap apes feature

This obviously gave the animators a lot more reference data to work with, allowing them to take the traits of actors and their performances and translate them into animated results.

But what's surprising is just how detailed the team at Weta go with the process.

At the start of filming, Weta seats the actors down in a chair with two mirrors capturing their profile reflection, and makes them pull faces. This gives the animators a solid reference point to help customise a digital ape to the actor playing that role.

"The first part is all motion range of how the eyes affect the eyelids, the eyebags; how much the flesh is on the upper part of his eyes… all those details we incorporate onto Caesar afterwards. Everything is muscle based – everything is based on actual anatomy," explains Alessandro Bonora, lead facial modeller at Weta.

Weta Digital mocap apes feature

For Andy Serkis' Ceasar, software gave the animators control over 240 muscles in the ape's face, which was carefully matched to Serkis' own facial performance.

While not all of the controls are needed for every character in the film, each rig is created using a combination of both human and ape biology, depending on both the actor and the ape they were playing. Lead villain Koba, for example, was more ape-like than Caesar, but with some very human muscle motion included to sell Toby Kebbell's performance.

One example Bonora gave us was with the platisma muscles – the strong neck muscles that tend to stand out when you're yelling – which are commonly found on the back of an ape, as opposed to the front of the neck. But to capture the intensity of Toby Kebbell's performance, they included them at the front on Koba.

"We take those sort of liberties to improve the quality of the performance," Bonora explains. "Sometimes we go to the extent of matching wrinkles, when the wrinkle or the form is very prominent on the performer."

The future of digital chimps

As impressive as the end result is on Dawn of the Planet of the Apes, the technology behind motion capture is still a long way from perfection.

While there's confidence that the visual effects team can now capture an actor's performance and turn it into a digital character on a one-to-one basis, there's still room for improvement, as Dan Barrett explained.

Weta Digital mocap apes feature

"I think it's going to get more and more incremental. I think we've made some reasonable leaps over the last few years, and I think it's going to get more and more incremental. But we're always looking to improve, and trying to get our water or rain simulations better, or whatever it might be," Barrett said.

"I think that the more that we can free it up, the more inconspicuous we can be as the team on set - and that's happening thanks to wireless technology and things - we can be out of the way and almost invisible on set."

Dawn of the Planet of the Apes is available on Blu-ray and digital now

Having spent the past decade editing some of Australia's leading technology publications, Nick's passion for the latest gadgetry is matched only by his love of watching Australia beat England in the rugby.
Latest in Entertainment
Trinity Rodman #2 of the Washington Spirit crosses the ball during a game between Bay FC and Washington Spirit at Audi Field on November 10, 2024 in Washington, DC.
National Women's Soccer League 2025: How to watch NWSL games live from anywhere
Irish boxer TJ Doheny receives an undercard bout, ahead of the WBO super welterweight world title fight in March, 2023
Ball vs Doheny live stream: how to watch the boxing action from anywhere
Bruno Guimaraes of Newcastle United during the Carabao Cup Semi Final Second Leg match in February 2025
Liverpool vs Newcastle live stream: how to watch Carabao Cup final 2025 online
The Russo brothers posing for a photograph and Herman carrying a Volkswagen camper van in The Electric State
'We're optimists': AI enthusiasts Joe and Anthony Russo defend its use in movies and TV shows, but admit there are 'very real dangers' around its application
Max Verstappen of Red Bull in testing for the 2025 season in Bahrain
Australian Grand Prix 2025: How to watch F1 race online from anywhere
A collage of Tom Holland's unmasked Spider-Man and Sadie Sink's Max in Stranger Things season 4
Marvel reportedly casts Stranger Things star Sadie Sink in Spider-Man 4, but I don't want her to tackle the roles she's rumored to play
Latest in News
Super Mario Odyssey
ChatGPT is the ultimate gaming tool - here's 4 ways you can use AI to help with your next playthrough
Ray-Ban smart glasses with the Cpperni logo, an LED array, and a MacBook Air with M4 next to ecah other.
ICYMI: the week's 7 biggest tech stories from Twitter's massive outage to iRobot's impressive new Roombas
Brad Pitt looks over his right shoulder with 'F1' written behind him
Apple Original Films will take you behind-the-scenes of a racing cockpit in this new thrilling F1 movie trailer
AI writer
Coding AI tells developer to write it himself
Reacher looking down at another character from the Prime Video TV series Reacher
Reacher season 3 becomes Prime Video’s biggest returning show thanks to Hollywood’s biggest heavyweight
Finger Presses Orange Button Domain Name Registration on Black Keyboard Background. Closeup View
I visited the world’s first registered .com domain – and you won’t believe what it’s offering today