Animatronics Look Like Real Humans, Use New Physical Face Cloning Method

Due to its expressive power, replicating the human face presents huge challenges. To deliver compelling and realistic performances, an animatronic character must produce a vast range of facial expressions, each having different deformations and wrinkles. Manually designing the shape and material properties of a single skin that is able to achieve all of these targets is a formidable task. The Zürich researchers, however, invented a computational method for automatically designing synthetic skin to match real individuals.

The process starts by scanning 3D facial expressions from a human subject. Then, a novel optimization scheme determines the shape of the synthetic skin as well as control parameters for the robotic head that provide the best match to the human subject. This processing increases the realism of the resulting character, resulting in an animatronic face that closely resembles the human subject.

“With our method, we can simply create a robotic clone of a real person,” said Dr. Bernd Bickel, researcher at Disney Research, Zürich. “The custom digitally designed skin can be fabricated using injection molding and modern rapid prototyping technology. We 3D print a mold and use elastic silicon with properties similar to human skin as base material”. Their findings were presented at ACM SIGGRAPH 2012, the International Conference on Computer Graphics and Interactive Techniques.

“Our research focuses on the creation of the silicone skin,” explained Dr. Peter Kaufmann, researcher at Disney Research, Zürich. “We use computation to carefully modify the thickness of the skin across the face, leading to deformations that closely match those of the real human.”

Prof. Markus Gross, director of Disney Research, Zürich, applauded the results, stating, “This innovative research builds upon our heritage in ‘Audio-Animatronics’ pioneered by Walt Disney himself. Physical face cloning enables us to create personalized animatronic figures based on real individuals with a level of fidelity and realism never before possible.” 

In addition to Dr. Bickel and Dr. Kaufmann, the research team included Melina Skouras and Thabo Beeler, PhD students at ETH Zürich and associate researchers at Disney Research, Dr. Bernhard Thomaszewski and Dr. Derek Bradley, postdoctoral researchers at Disney Research, Zürich, Phil Jackson, Imagineer at Walt Disney Imagineering R&D, Prof. Steve Marschner, associate professor at Cornell University, Prof. Wojciech Matusik, associate professor at MIT, and Prof. Markus Gross, director of Disney Research, Zürich.

For more information, please visit the web site at 

http://www.disneyresearch.com/research/projects/m_PhysicalFaceCloning_drz.htm

Contacts and sources:
Jennifer Liu 
Disney Research