Interactive 3D Visuals Using Kinect and Unity 3D

Submitted by Jared; July 13, 2011


Here's another great hack that demonstrates the type of creativity you can squeeze out of a little kinect sensor when pursuing a great idea. This was designed to be used at the 2011 Trailerpark Festival and let's the audience use their own gestures in order to control the lighting or scenes that are displayed on a set. The set is modelled in 3D and calibrated perfectly with preset that integrate with Kinect gestures. The real genius of the project is demonstrated at the 1:10 mark when rectangles appear to be dangling out of holes which are simply 3D models with accurate shadow and depth projections onto the set. It creates a really cool effect that I'm sure visitors to the festival will really enjoy. The developers used OpenFrameworks and OpenNI for tracking along with Unity3D and VDMX with Syphon for mixing the Unity pre-rendered content.


Tags: OpenFrameworks, OpenNI, Syphon, Unity3D, VDMX