The world has changed a lot since you were a wide-eyed, innocent kid playing with your handmade sock puppet. Puppets have come a long way too.
This week, NYSCI opens Puppet Parade, a new type of puppetry created by Design I/O that uses computers and Xboxes to merge the movements of real people with projections of larger-than-life creatures. Puppeteers control the animals using their hands and arms. Then their actions are tracked through Xbox Kinects, the data is sent through a computer to a projector, and presto! – a fantastical, interactive scene is displayed on a 17-by-26-foot wall.
The experience includes all the entertainment of that old sock puppet, while also including the interactivity and special effects of today’s technology.
A test using a kinect to identify a sanitation truck being placed against the wall. The rubbish is then collected by the truck, disappearing from the projection.
Testing sharing resources between two installations. The system can detect and identify boxes ( our cargo trucks ) and add resources from one installation and have the trucks transport the resources to another installation. Note: This is proof of concept and doesn’t represent a final installation. We’re using computer vision for the identification in this prototype but a more robust and flexible solution would probably involve rfid.
our prototype ‘smart truck’