Gesture Recognition

Unified Field’s gesture recognition software can transport museum guests and corporate clients to new worlds. Visuals and sounds respond to a visitor’s motion and gestures, creating a sense of wonder and delight that quickly leads to deeper engagement. By waving their arm or moving their whole body, gesture technology lets visitors navigate through information, travel through a landscape or control an animated character. We’ve had great fun creating experiences where visitors can put themselves into games, explore giant machines and even digitally transform themselves into mating animals.

General Electric

American Competitiveness Conference

Our task was to create an experience so engaging that it would spark conversations about GE’s vast capabilities while highlighting its history of job creation and innovation. We conceptualized and created the content, animations, and 3D models for gesture technology experiences that seamlessly integrated into large curved fabric exhibit structures. Visitors flew a 3D model of a plane, explored the inside of an engine, drove a high speed virtual train and swiped through decades of innovation and invention in ways that were so playful that conversations started naturally.

The Strong: National Museum of Play

Bubble Tower

The large-scale, gesture technology experience for the Strong Museum uses real time video extraction with depth imaging. Visitors see themselves inside a delightful illustrated scene where they can play with a cascade of virtual bubbles. Real time video filtering slightly stylizes the imagery of visitors to fit with the look of the scene. Multiple visitors can play at once, discovering gestures that allow them to collect bubbles on their hands, form bubble tornadoes, or capture images of their faces inside bubbles. The curator of The Strong calls this iconic piece "the ultimate bubble selfie.”

California Academy of Sciences

Color of Life

The Color of Love interactive uses gesture technology to track players’ body movements as they dance to mimic the mating moves of an animal. As a player matches their animal’s moves, their own image transforms, piece by piece. The gesture technology senses the player’s 2D silhouette and 3D skeleton. We reconcile the two in order to accurately apply 3D model animal parts to the player’s image. Players who match their animals’ movements see their shapes fully transform into the mating animals.