AIGenerated
EN · IT · ES

Disney's new Star Wars robots use AI to talk to you in real time

Three Anzellan alien figures at Disney can hear and watch guests, then pick scripted lines and movements on the fly — no puppeteer needed.

Apps and productsDisney's new Star Wars robots use AI to talk to you in real timeHerald of AI
How it works

AI-powered animatronic characters that choose pre-written lines and movements by watching and listening to guests

  1. Robots watch and listen to you with hidden cameras and mics
  2. Sensor data goes to cloud servers with two AI models
  3. The robot speaks and moves from pre-approved lines and gestures only

In short

What happened: Instead of relying on a hidden human operator, Walt Disney Imagineering created three small Star Wars robots that observe and listen to guests at the park and independently pick their responses in real time by using Amazon Web Services (AWS) AI.

  • Why it matters: If Disney rolls this technology into its theme parks, visitors could get a different conversation every time they meet a character, rather than hearing the same scripted line on repeat. For now, only conference attendees will get to try them first.

What you could do with it

  • A theme park visitor could approach one of these Star Wars characters and have a unique conversation every time, with the figure reacting to their words and movements instead of repeating the same script 1.
  • The technology behind these AI-driven animatronics could eventually be used in attractions like Star Wars: Galaxy's Edge, where characters would surprise guests while staying entirely within pre-approved dialogue and motion 1.
  • Conference attendees at events like AWS re:Invent could interact directly with the three Anzellan robots to test whether the fast-decision AI layer keeps reactions feeling natural in a noisy, unpredictable crowd 1.

A new kind of animatronic

For decades, Disney's Audio-Animatronics figures have performed the same choreographed routine over and over, like the singing birds in Disneyland's Enchanted Tiki Room 1. Even the newest, most lifelike robots either follow fixed sequences or are controlled by an unseen handler — the recent Olaf figure, for example, is driven remotely with a Steam Deck .

These three new prototypes break that pattern. Drawing inspiration from the Anzellan aliens featured in The Mandalorian and Grogu, the robots contain concealed cameras and microphones that record visitors' actions and words. That sensor data is sent to cloud servers, where a number of AI models analyze it in real time to decide every character's dialogue and physical gestures 1. Every possible line and gesture, though, was already written and designed ahead of time by Disney Imagineers .

The three characters are named Vilo Vele, Kado Bre'a and Jibu Bre'a 1. They make their first public appearance at the AWS re:Invent conference in Las Vegas later this month, where attendees can interact with them . Disney has not announced a theme park debut, but the characters and the technology behind them could eventually appear in Star Wars: Galaxy's Edge and other attractions .

At a glance

Old Disney robots versus the new AI ones

Old animatronicsNew AI animatronics
ConversationSame lines every timeDifferent reply each visit
What triggers itFixed choreography or a hidden operatorGuests' words and movements via cameras and mics
Decision speedNot applicableTwo cloud AI models — one fast for split-second reactions, one slower for longer exchanges
Content sourceFully scripted routinesPre-written lines and gestures selected by AI from approved material
Characters mentioned—Vilo Vele, Kado Bre'a, Jibu Bre'a

Two brains working together

Each figure relies on two layers of AI running in the AWS cloud, split to solve a problem all interactive characters face: timing 1. A lightweight, fast-decision model handles split-second reactions — like a character locking eyes with someone who just walked up — so the response feels immediate . Larger, slower models weigh the wider context of the conversation and plan longer exchanges .

The robots also react to each other, not just to people. Disney explained one example situation: when a guest walks up, all three figures rotate together; one talks using a mix of English and the Anzellan language, a second blinks while tilting its head, and a third examines the guest and then says, "we have something special for you" 1.

Staying inside the script

Critically, the AI never writes new dialogue or invents new movements 1. It selects from prerecorded audio clips played back alongside dynamically animated motions . Imagineers designed every line, every personality quirk, and every gesture . The models simply decide which pre-made piece of content to use and when .

Disney said the goal is "a set of characters that surprise the guest, without surprising its creators or artists" 1. By sticking the characters to a set script, Disney sidesteps the dangers that come with open-ended generative AI in a family setting, since an unscheduled line from a Star Wars figure could turn into a public relations issue .

The project also extends Disney's existing relationship with AWS, which currently powers its Disney+ streaming service 1. What starts as a cloud infrastructure partnership is now reaching into physical, guest-facing entertainment .

Whether the system can keep its reactions snappy on a loud, crowded convention floor remains to be seen — that test begins at re:Invent 1. If it holds up, Disney will have a blueprint for park characters that behave differently with every visitor while staying safely within material its artists approved .

Key facts

  • Three Anzellan alien robots can react to guests in real time without a human handler.
  • AI models on AWS decide which pre-scripted lines and movements each character uses.
  • First public demo at AWS re:Invent in Las Vegas; no park debut announced yet.
  • The robots cannot generate new speech or motion — they pick from pre-written material only.
  • Two AI layers handle timing: a fast model for immediate reactions, larger models for longer conversations.

Sources

  1. Disney's new Star Wars robots use AI to react to guests in real time — techspot.com

If this story concerns you or your company, or uses something that belongs to you, ask for a correction or for it to be taken down. How requests work

Keep reading