Disney Imagineering has debuted a new highly-anticipated audio-animatronic technology with the reopening of the classic Pirates of the Caribbean attraction at Disneyland. This advanced new system system combines hybrid front projection technology with a partially articulated mechanical face to bring characters to life in impressive new ways and can now be seen on display in the iconic treasure room scene of the attraction with a new pirate figure.

Here’s a closer look at all the juicy details about the new hybrid front projected animatronic.

The Backstory

Seemingly unnamed for now, the new pirate figure is caught in a wicked loop thanks to the curse on a piece of treasure that the scoundrel has found. When the unassuming ne’er-do-well cad plucks the enchanted coin from the chest he is able to admire his plunder for a short moment before the curse turns him into a still skeleton. Lifting the coin casts a spell that freezes the marauder into skeleton form, causing his arm to drop the coin and release the spell, only for his greed to drive him to pick it up again for eternity.

As you drift past on your bateaux, you may see the unlucky blighter cycle through three distinct moods before he transforms with slightly different reactions to seeing the treasure each time.

The Technology

Since the attraction’s opening nearly 60 years ago, this skeletal figure was frozen in time as a skeleton a top the glittering mound. With the integration of the new hybrid front projection technology he is now not only able to spring to life but also completely change the appearance of his face.

This hybrid front projection technology serves as an extension of traditional animatronics by tracking moving figures and objects in real time. The animatronics animation system controls the figure’s physical movements while simultaneously feeding that data into their figure animation system powered by Unreal Engine through an ongoing partnership with Epic Games.

To ensure the projected image lines up precisely every time, a newly patented technique utilizes calibration markers built directly into the pirate’s bandana costume. Cleverly, these integral QR codes used for tracking camera calibration are hidden from sight by guests via black light ink that can only be seen under UV light.

The scene operates with two projectors that act as backups for one another, allowing the image to stay perfectly locked onto the figure’s face — even if a motor fails. In the video we see Imagineers even moving the figure’s face by hand and the projection tracking follows in perfect sync. That basically means the face does not have to be in the absolute exact same position for the effect to work.