Gallery

This page collects videos of various people doing tests and experiments with OpenKinect software, and Kinect themed websites:

Kinect Themed Sites

• http://www.reddit.com/r/openkinect OpenKinect news and discussion community
• http://kinect-hacks.net - Kinect Hacks, news, gossip and videos
• http://www.kinectHacks.net - Kinect hacking blog and forum
• http://www.freenect.com - Kinect hacking news
• http://www.modmykinect.com - The innovation begins.
• http://www.Bodensee-Deal.de - Kinect hacking news in German
• http://www.kinectxbox360.es - Novedades, hacks y juegos de kinect en español.
• http://www.kinectHacks.nl - Dutch Kinect hacking blog and forum
• http://live4d.de/index.php?/XBox-360-Kinect-Sensor-Hacks-Blog/Kinect-Sensor-Hacks-News/ - German site

Demos

3D Depth Sculpting using copies of my own body and other objects

	I became intrigued with the possibility of sculpting in 3D using the Kinect by periodically recording the nearest object to the camera in each part of the image. By taking multiple 3D snapshots at different times and then merging them to show the closest object, I can create a 3D sculpture that I can walk through. Here I merge multiple 3D video streams. http://www.youtube.com/watch?v=LKjzbyBpkM8
	Here I use a "depth strobe", where I grab snapshots 1-2x a second.
	Here I take a single snapshot with some furniture and then remove it, allowing me to wander through the ghost of the furniture. http://www.youtube.com/watch?v=abS7G5ZT17c
	Here I update the 3D background continuously, creating a slur of objects. http://www.youtube.com/watch?v=rBLYsB9BBSk. Created in Python using the Python wrapper.

People Detection

Real-time people detection using two kinect. http://www.youtube.com/watch?v=x--xlKWBTAE

Florian Echtler (floemuc)

"Multi-touch" interactions http://www.youtube.com/watch?v=ho6Yhz21BJI Created with the libTISCH multitouch library: http://tisch.sf.net/

Pete & Matt

	Fun with a "Kinect piano"! A vastly improved piano: http://www.youtube.com/watch?v=VgLp-KyK5g8
	Original version for posterity: http://www.youtube.com/watch?v=ppHcj15LypM

okreylos

3D depth video capture http://www.youtube.com/watch?v=7QrnwoO1-8A measuring objects in 3D http://idav.ucdavis.edu/~okreylos/ResDev/Kinect/

koabi's work

• http://www.youtube.com/profile?user=DerKorb#g/u

Diarmuid Wrenne diarmuid@bluekulu.com

	3D depth video capture http://www.youtube.com/watch?v=7QrnwoO1-8A measuring objects in 3D http://idav.ucdavis.edu/~okreylos/ResDev/Kinect/
	A second version of the green screen demo. This one does movies too.
	3D point cloud rendered with boxes with scaling. Also superimposing 3d models into the scene (a rifle of course). Also using OSC from an ipad to control the scene. http://www.youtube.com/watch?v=4yp37U-YHv4
	3D Point cloud viewer. http://www.youtube.com/watch?v=T8bkAQ-VxXg
	Extracting rotation data from real objects and mapping that to new virtual ones. Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism. http://www.youtube.com/watch?v=bO3YwW3WajI
	Driving Quake Live with a kinect. It uses openkinect, python bindings and web.py on the linux to expose nearest point data. The imac runs Quake and a custom java program that calls the linux web server. It uses java.awt.Robot to generate mouse and key stroke events. http://www.youtube.com/watch?v=uvP2u2yOcNw Sorry about the resolution but I'll try to upload a better one later.
	Extracting rotation data from real objects and mapping that to new virtual ones. Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism. http://www.youtube.com/watch?v=bO3YwW3WajI
	Openframeworks, box2d, opencv and ofxkinect. This uses the depth map to determine the closest point to the kinect. It uses this point to draw a line that is part of the box2d world. This line can then be moved around by moving your hand or a magic wand (in my case a roll of string!!) so that other objects with in the 2d world can be manipulated. Works well. http://www.youtube.com/watch?v=pR46sXjEtzE
	Openframeworks, Box2d and opencv. Uses the blobs generated by opencv contours to generate a box2d object to manibulate other box2d objects. Works OK but filtering the blobs is quite error prone http://www.youtube.com/watch?v=NlrKcpUPtwM
	Using web.py to web enable a kinect on linux. http://www.youtube.com/watch?v=PYq9gkdpiS8

Kyle point cloud viewer

• Initial render in processing: http://www.flickr.com/photos/kylemcdonald/5167174610/
• Viewer substituting glview.c: http://www.openframeworks.cc/forum/viewtopic.php?p=24884#p24884
• advanced viewer with DOF using ofxKinect: http://www.openframeworks.cc/forum/viewtopic.php?p=24958#p24958

cclaan

Point cloud plus color. http://vimeo.com/16788233

yankeyan

	Awesome object recognition! http://www.youtube.com/watch?v=fQ59dXOo63o and http://www.youtube.com/watch?v=cRBozGoa69s
	Lightsaber tracking and rendering http://www.youtube.com/watch?v=3EeJCln5KYg

Memo Akten

Drawing in 3D http://vimeo.com/16818988

L14M333

	Moving the motor with a GUI while showing video streams: http://www.youtube.com/watch?v=KsvQpUnlp-Y
	Plotting accelerometer to graph and calibration http://www.youtube.com/watch?v=GWvcgZkADUU (Uses CL NUI (Will switch later))
	Using kinect as a mouse http://www.youtube.com/watch?v=-3-TA6URf9M (Uses CL NUI (Will switch later))
	Kinect used to control mouse (v2) with source: http://www.youtube.com/watch?v=wBoVrZZlmJ0&hd=1
	Turning TV into touch screen TV using Kinect: http://www.youtube.com/watch?v=tlHzqeIhDiQ
	Another KinectTouch demo improved source fully commented: http://www.youtube.com/watch?v=JlwWp8ItCVA&hd=1

• Single object detection and improved framerate: http://tinyurl.com/handtrack
• Get latest source code of mine from: http://get.essexconsolerepairs.co.uk/kinecttouch

arne_

Full image of the IR dot field:

• http://livingplace.informatik.haw-hamburg.de/blog/wp-content/uploads/2010/11/kinect1.png

kode80apps

	Head tracking for 3D vision using OpenKinect software. http://www.youtube.com/watch?v=Y-f_oMOvNAk
	http://www.youtube.com/watch?v=CddvvlP4UNM

James Patten

Multitouch Tracking on arbitrary planes with Kinect http://www.youtube.com/watch?v=Bth0TkRLVtk

cruxphotography

Box cloud http://www.youtube.com/watch?v=e8h6DL0Dc84

Daniel Reetz

Removing the IR cut filter from your camera and examining the Kinect IR field, including high res image:

• http://www.futurepicture.org/?p=97

Emily Gobeille - Theo Watson

Digital puppetry with Kinect http://vimeo.com/16985224

DustyDingo

Two Kinects facing same direction, experiments:

• [1]
• [2]
• [3]

Rolling shutter experiments:

• Setup: http://atommuell.mum.jku.at/~aurel/kinect_roling_shuter_proto_2.jpg

The top image is a plain kinect, the other one has a rolling shuter in front of the laser projector. Both kinect operate at the same time.

• http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction_c_both_one_proj_shutter.png

Holding the kinect automatically on level:

• [4]

yoda--

• Fist detection http://yoda-jm.performous.org/freenect/in2.png

Zephod / Stijn Kuipers

Windows RBG to Z Projection http://vimeo.com/17007842

Zappadoc / URBI Implementation

• URBI/Urbiscript implementation http://www.urbiforge.org/index.php/Modules/UKinect

netpro2k / Dominick D'Aniello

	Quick background removal and parallax demo http://vimeo.com/17023522
	3D object manipulation http://vimeo.com/17045326
	Kinect Kart http://vimeo.com/17075573

evoluce

Controlling Windows 7 applications with Kinect http://www.youtube.com/watch?v=M-wLOfjVfVc

marcan

	http://www.youtube.com/watch?v=rKhW-cvpkks The video that started it all.
	http://www.youtube.com/watch?v=Q1heqFVrQGU Laser projection on a moving surface in perspective, using the Kinect for tracking.

imekinox

	"AS3 first communication" http://www.youtube.com/watch?v=_9sDY6WO4mY
	"AS3 second phase, motor & accelerometers" http://www.youtube.com/watch?v=SvfDvGaY348
	"AS3 Very simple hand tracking" http://www.youtube.com/watch?v=yFy_NYcWDMk
	"AS3 Multiple hand tracking" http://www.youtube.com/watch?v=HWIRSQuuqm0

Eric Gradman (egradman)

"Standard gravity" art project using libfreenect and python http://www.youtube.com/watch?v=uaci4dcZxYE

Scott Byrns

Point Cloud in Java. http://www.youtube.com/watch?v=oIyTCvi-XSI

• Poor-mans Object Tracking in Java. http://www.screencast.com/users/mscottb/folders/Jing/media/fca9fb5e-2053-4614-b1f6-047ebbd4a8ad

Ben X Tan

	Actually...this isn't using OpenKinect. I'm using CL NUI at the moment which is in C#, but I will switch over to libfreenect c++ version on Mac soon... Midi Controller v0.1 - http://www.youtube.com/watch?v=z1Wp0HEYxSg Midi controlling notes on the X and Y axis http://www.youtube.com/watch?v=-3-TA6URf9M - l14m333 using my code as a mouse controller http://www.youtube.com/watch?v=OilcNuX404o - TIM885885 using my program to play chinese music. Actually sounds musical! v0.2 - http://www.youtube.com/watch?v=fCQwNLKJlCU Now shows heat map and plays the C major scale in a 2 octave range. Will be configurable later v0.3 - No video yet, but I just got it to talk to Ableton Live!

Jean-Marc Pelletier - Nenad Popov - Andrew Roth

• jit.freenect.grab: A Max/Jitter external to grab data from the Kinect. http://jmpelletier.com/freenect/ https://github.com/jmpelletier/jit.freenect.grab

	http://www.youtube.com/watch?v=WIJA46ocia0
	http://www.youtube.com/watch?v=wS8wyIYn77w

Phillipp Robbel

Early experiments with a Microsoft Kinect depth camera on a mobile robot base. http://www.youtube.com/watch?v=dRPEns8MS2o

Jasper Brekelmans

Kinect 3D PointCloud Scanner. http://www.youtube.com/watch?v=bZi-1NmQAGM&feature=player_embedded

Thomas Hansen

Segmenting point cloud pixels based on depth ranges. http://vimeo.com/17085043

Preston Holmes (ptone)

	Control of DMX based lighting via Kinect. http://www.youtube.com/watch?v=Kg0Rvj-Seto
	Controlling GarageBand: http://www.youtube.com/watch?v=u2-e9YMdadE

Peter Nash (pedronash)

Playing around with Processing and Java - seeing what's fun. My experience so far is mostly in smart calibration. http://www.youtube.com/watch?v=2lF8OJoWogY

Willow Garage

Several projects including multiple kinect integration and teleoperation of robots. Read more at http://www.willowgarage.com/blog/2010/11/22/kinect-ros-moving-forward-quickly video: http://www.youtube.com/watch?v=rYUFu64VXkg

Henry Chu

	Reflection - art exhibit. http://vimeo.com/16959492
	Interacting with a three-second delayed shadow of yourself. http://vimeo.com/17040999

Parag K Mital

Sound modulating point clouds: http://vimeo.com/16964263

CADET

	Making opensource engine 2Real for fullbody interaction and mixed reality applications. Kinect Generative Game Prototype http://www.vimeo.com/17135419
	Kinect skeleton library first baby steps http://www.vimeo.com/17220351 (we just started). Center for Advances in Digital Entertainment Technologies http://www.cadet.at

Achim Kern

Quick test using Kinect to control a digital pin-board in TouchDesigner. http://vimeo.com/17211596

Dongchul Kim (T9T9)

	OpenKinect group in Korea, http://openKinect.co.kr. 3D Cube Clouds http://www.youtube.com/watch?v=_rIV3FMbekM
	Hand Printing http://www.youtube.com/watch?v=9XwPpTOPY8k

Integration in MRPT: Very simple visual SLAM

	Part 1: Example code for how to grab Kinect observations, do multi-threading, convert range data to a 3D point cloud and render in real-time. More info here.
	Part 2: Very simple demonstration of how to grab Kinect observations, perform visual feature tracking and build a 3D map (SLAM). More info here.

Kinect running a website

First Kinect compatible website http://www.youtube.com/watch?v=1QjYIrNWxks

Martin Kaltenbrunner

	TuioKinect tracks simple hand gestures using the Kinect controller and sends control data based on the TUIO protocol. This is a preliminary proof of concept implementation, which still needs several improvements to become fully usable. Nevertheless it should work out of the box with most TUIO client applications. You can download the source code and a mac binary from its page
	The Therenect is a virtual Theremin, which defines two virtual antenna points that allow controlling the pitch and volume of a simple oscillator. The distance to these points can be controlled by freely moving the hand in three dimensions or by reshaping the hand, which allows gestures that should be quite similar to playing an actual Theremin.

Switch On The Code

• Kinect getting started tutorial using libfreenect and the C# wrapper.
• Demonstrates how to display the RBG data and depth data as a grayscale depth map.

http://www.switchonthecode.com/tutorials/kinect-tutorial-hacking-101

RGBDemo: 3D Scene Reconstruction and people tracking/height estimation

	Freehand scanning of a room using image-based relative pose estimation.
	People detection with height estimation: http://www.youtube.com/watch?v=nnCDOKLuu0g

Software available at http://nicolas.burrus.name/index.php/Research/KinectRgbDemoV4

GeckoSystems Mobile Robot

A GeckoSystems Carebot(tm) has been retrofitted with a pair of Kinects to improve data acquisition for it's autonomous navigation software GeckoNav.

3D Body Scan Using Multiple Kinects - Data and Interference Analysis

We simulated a full body scanner using data from 4 views. http://www.youtube.com/watch?v=9MwS_nk9n2A

MikuMikuDance

MikuMikuDance is a free dance simulator that uses takes its own file format for 3d human characters, and performs a dance with it by editing the position of "bones" inside the model, frame by frame It is a companion program to a nonfree singing text-to-speech program called Vocaloid The later versions can match the 3d animated character's position to Kinect motion data

Gestural Interaction for Training Simulations

We used the Microsoft Kinect to create a simple free-handed interface for navigating a 3D world and performing triage. We also developed a walking system for physical exertion. We actually use the OpenNI software with the driver package provided by avin and the Unity wrapper provided by tinkerer. http://www.youtube.com/watch?v=-lLCu22INT8