Olaf the Robot: Is This Disney Parks' Future?

Disney Imagineering has unveiled what it considers the pivotal innovation for populating its theme park lands with lifelike robot characters.

Before the current wave of pop culture phenomena, Disney’s *Frozen* captivated audiences globally with its iconic show tunes like “Let It Go” and “Into the Unknown.” This enduring popularity has made characters such as Olaf household names.

Encountering the robotic rendition of Olaf, developed by Disney Imagineering, immediately sparked a personal thought: the eagerness for my own children to experience this marvel.

It's a curious reaction, considering this Olaf is an inanimate object, incapable of genuine conversation, and largely a remote-controlled puppet operated via a Steam Deck gaming handheld. Yet, the inclination to refer to it as "him" persists.

The explanation lies in Olaf’s remarkable ability to navigate the uncanny valley, particularly when in motion. Set to debut at Disneyland Paris on March 26th and Hong Kong Disneyland this summer, Olaf achieved this lifelike quality through a unique training method. Disney animators, utilizing an Nvidia-powered simulation, created 100,000 virtual copies of the physical robot. These digital Olafs were then subjected to reinforcement learning, rewarded for movements that precisely mirrored animated actions. This intensive training, powered by an Nvidia RTX 4090 GPU, was completed in just two days.

Kyle Laughlin, SVP of R&D at Disney Imagineering, asserts to The Verge, "This absolutely is the future of how we’re building robot characters." He highlights reinforcement learning as the "true unlock" that could enable Disney to fill entire lands with interactive characters, streamlining robot development from years to mere months.

While Disney Imagineering previously employed similar techniques for its *Star Wars* droids, Laughlin distinguishes those as "robots being robots." Olaf, he notes, represents a significant leap: "This is our first animated character that we brought to life."

To be clear, Olaf is not equipped with artificial intelligence. The 35-inch-tall, 33-pound robot houses 25 actuators and three computers, including an Nvidia Jetson Orin NX and a Raspberry Pi. Its dialogue consists of prerecorded lines, delivered in the distinctive voice of Josh Gad, synchronized with its animated movements.

Though Olaf blinks autonomously, direct eye contact with guests requires an operator to manipulate a joystick. The Steam Deck’s other joystick controls Olaf's locomotion, while a touchpad allows operators to swiftly access a wide array of conversational responses. During an early demonstration, the interaction was somewhat limited, often yielding brief phrases like "Of course!" or "Sure!"

Nevertheless, Olaf's movements are captivating. It's difficult to look away, and the use of the pronoun "him" becomes automatic. His waddling gait is remarkably convincing. Moritz Bächer, Disney Research lab director, succinctly explains the core of this illusion: "The eyes go first, and the body follows." This sequence triggers an automatic assumption of sentience, as eye movements are mentally associated with conscious control.

Adding to the illusion, Olaf’s four-way-stretch costume, constructed over foam "snowballs," sparkles like freshly fallen snow under light. Its magnetic carrot, sticks, and buttons allow for easy reattachment or even playful detachment as a gag.

Despite Disney's reputation for fiercely protecting its intellectual property, its approach to robot research is notably different. Last March, it collaborated with Nvidia and Google DeepMind to release the Newton Physics Engine as an open-source project under the Linux Foundation. Now, Disney Research is also contributing Kamino, the simulation tool developed for training "extremely complex mechanical assemblies" like Olaf. Kamino includes a basic thermal dynamics model to prevent premature joint overheating in robots.

The team revealed that Olaf presented unique engineering challenges. Robots typically aren't designed with large, heavy heads atop slender necks, which places considerable strain on that joint and increases the risk of overheating. Olaf's characteristic "clomp-clomp-clomp" walking also posed a noise reduction challenge. However, the reinforcement learning simulation enabled Disney to reward the 100,000 virtual Olafs that moved efficiently without overheating or excessive noise. Laughlin likens this process to a parent's gentle guidance: "It’s like telling my six-year-old to stop running through the house: Can you just be a little bit quieter? That’s pretty much what we had to do for Olaf."

Bächer clarifies that these development tools are designed to seamlessly integrate with existing animator software, such as Maya. This allows animators to craft motions that convey specific emotions, with the physics simulation then determining how the robots can realistically execute those actions.

Admittedly, the illusion can break when Olaf becomes stationary. Disney Research has not yet indicated when these robots might achieve true autonomy, suggesting that current technology does not meet Disney's stringent standards. Bächer emphasizes the goal of "believable autonomy": "It needs to be something that you believe is real."

However, control won't always reside with a human operator and a Steam Deck. Olaf is capable of time-coded performances, directly integrated into Disney's live entertainment choreography systems, according to Laughlin. This will be one of his initial appearances at Disneyland Paris, performing on a boat in a lagoon in front of the castle. "We built a mock boat in our R&D lab to simulate the considerable amount of rocking back and forth in this boat, and Olaf does an incredible job staying afloat," Laughlin states, adding, "He’s got his sea legs."

These performances are expected to become even more intricate as Disney introduces additional robots. Laughlin hints, "You can expect to see more robots from franchises together so that they can interact."

He further suggests, "The real power is going to come from Olaf interacting with characters that he knows and loves. Not only performers, but also other characters that we haven’t been able to bring to life without robotics."

Disney Research has published an eight-page white paper detailing the creation of Olaf, including specific components and formulas used, available for review.