Notice: MediaWiki has been updated. Report any rough edges to marcan@marcan.st
Gallery
This page collects videos of various people doing tests and experiments with OpenKinect software.
3D Depth Sculpting using copies of my own body and other objects
I became intrigued with the possibility of sculpting in 3D using the Kinect by periodically recording the nearest object to the camera in each part of the image. By taking multiple 3D snapshots at different times and then merging them to show the closest object, I can create a 3D sculpture that I can walk through.
Here I use a "depth strobe", where I grab snapshots 1-2x a second
http://www.youtube.com/watch?v=inim0xWiR0o
Here I take a single snapshot with some furniture and then remove it,
allowing me to wander through the ghost of the furniture:
http://www.youtube.com/watch?v=abS7G5ZT17c
Here I update the 3D background continuously, creating a slur of
objects:
http://www.youtube.com/watch?v=rBLYsB9BBSk
Created in Python using the Python wrapper.
Damien People Detection
Real-time people detection using two kinect
http://www.youtube.com/watch?v=x--xlKWBTAE
Florian Echtler (floemuc)
"Multi-touch" interactions http://www.youtube.com/watch?v=ho6Yhz21BJI
Created with the libTISCH multitouch library: http://tisch.sf.net/
Pete & Matt
Fun with a "Kinect piano"!
A vastly improved piano: http://www.youtube.com/watch?v=VgLp-KyK5g8
(Original version for posterity:)
http://www.youtube.com/watch?v=ppHcj15LypM
okreylos
3D depth video capture http://www.youtube.com/watch?v=7QrnwoO1-8A measuring objects in 3D http://idav.ucdavis.edu/~okreylos/ResDev/Kinect/
koabi's work
http://www.youtube.com/profile?user=DerKorb#g/u
Diarmuid Wrenne diarmuid@bluekulu.com
A second version of the green screen demo. This one does movies too.
3D point cloud rendered with boxes with scaling
Also superimposing 3d models into the scene (a rifle of course)
Also using OSC from an ipad to control the scene
http://www.youtube.com/watch?v=4yp37U-YHv4
3D Point cloud viewer http://www.youtube.com/watch?v=T8bkAQ-VxXg
Extracting rotation data from real objects and mapping that to new virtual ones.
http://www.youtube.com/watch?v=bO3YwW3WajI
Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!.
Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism.
Driving Quake Live with a kinect
http://www.youtube.com/watch?v=uvP2u2yOcNw
It uses openkinect, python bindings and web.py on the linux to expose nearest point data. The imac runs Quake and a custom java program that calls the linux web server. It uses java.awt.Robot to generate mouse and key stroke events.
Sorry about the resolution but I'll try to upload a better one later.
Openframeworks, box2d, opencv and ofxkinect
This uses the depth map to determine the closest point to the kinect. It uses this point to draw a line that is part of the box2d world. This line can then be moved around by moving your hand or a magic wand (in my case a roll of string!!) so that other objects with in the 2d world can be manipulated. Works well. http://www.youtube.com/watch?v=pR46sXjEtzE
Openframeworks, Box2d and opencv
Uses the blobs generated by opencv contours to generate a box2d object to manibulate other box2d objects. Works OK but filtering the blobs is quite error prone http://www.youtube.com/watch?v=NlrKcpUPtwM
Using web.py to web enable a kinect on linux. http://www.youtube.com/watch?v=PYq9gkdpiS8
Kyle point cloud viewer
initial render in processing: http://www.flickr.com/photos/kylemcdonald/5167174610/
viewer substituting glview.c: http://www.openframeworks.cc/forum/viewtopic.php?p=24884#p24884
advanced viewer with DOF using ofxKinect: http://www.openframeworks.cc/forum/viewtopic.php?p=24958#p24958
cclaan
Point cloud plus color http://vimeo.com/16788233
yankeyan
Awesome object recognition! http://www.youtube.com/watch?v=fQ59dXOo63o and http://www.youtube.com/watch?v=cRBozGoa69s
Lightsaber tracking and rendering http://www.youtube.com/watch?v=3EeJCln5KYg
Memo Akten
Drawing in 3D http://vimeo.com/16818988
L14M333
Moving the motor with a GUI while showing video streams: http://www.youtube.com/watch?v=KsvQpUnlp-Y
Plotting accelerometer to graph and calibration http://www.youtube.com/watch?v=GWvcgZkADUU (Uses CL NUI (Will switch later))
Using kinect as a mouse http://www.youtube.com/watch?v=-3-TA6URf9M (Uses CL NUI (Will switch later))
Kinect used to control mouse (v2) with source: http://www.youtube.com/watch?v=wBoVrZZlmJ0&hd=1
Turning TV into touch screen TV using Kinect: http://www.youtube.com/watch?v=tlHzqeIhDiQ
Another KinectTouch demo improved source fully commented: http://www.youtube.com/watch?v=JlwWp8ItCVA&hd=1
Single object detection and improved framerate: http://tinyurl.com/handtrack
Get latest source code of mine from: http://get.essexconsolerepairs.co.uk/kinecttouch
arne_
Full image of the IR dot field:
http://livingplace.informatik.haw-hamburg.de/blog/wp-content/uploads/2010/11/kinect1.png
kode80apps
Head tracking for 3D vision using OpenKinect software: http://www.youtube.com/watch?v=Y-f_oMOvNAk http://www.youtube.com/watch?v=CddvvlP4UNM
James Patten
Multitouch Tracking on arbitrary planes with Kinect http://www.youtube.com/watch?v=Bth0TkRLVtk
cruxphotography
Box cloud http://www.youtube.com/watch?v=e8h6DL0Dc84
Daniel Reetz
Removing the IR cut filter from your camera and examining the Kinect IR field, including high res image: http://www.futurepicture.org/?p=97
Emily Gobeille - Theo Watson
Digital puppetry with Kinect http://vimeo.com/16985224
DustyDingo
Two Kinects facing same direction, experiments:[1] [2] [3]
Rolling shutter experiments: Setup: http://atommuell.mum.jku.at/~aurel/kinect_roling_shuter_proto_2.jpg
The top image is a plain kinect, the other one has a rolling shuter in front of the laser projector. Both kinect operate at the same time. http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction_c_both_one_proj_shutter.png
Holding the kinect automatically on level: [4]
yoda--
Fist detection http://yoda-jm.performous.org/freenect/in2.png
Zephod / Stijn Kuipers
Windows RBG to Z Projection http://vimeo.com/17007842
netpro2k / Dominick D'Aniello
Quick background removal and parallax demo http://vimeo.com/17023522
3D object manipulation http://vimeo.com/17045326
Kinect Kart http://vimeo.com/17075573
evoluce
Controlling Windows 7 applications with Kinect http://www.youtube.com/watch?v=M-wLOfjVfVc
marcan
The video that started it all
Laser projection on a moving surface in perspective, using the Kinect for tracking
imekinox
"AS3 first communication" http://www.youtube.com/watch?v=_9sDY6WO4mY
"AS3 second phase, motor & accelerometers" http://www.youtube.com/watch?v=SvfDvGaY348
"AS3 Very simple hand tracking" http://www.youtube.com/watch?v=yFy_NYcWDMk
"AS3 Multiple hand tracking" http://www.youtube.com/watch?v=HWIRSQuuqm0
Eric Gradman (egradman)
"Standard gravity" art project using libfreenect and python http://www.youtube.com/watch?v=uaci4dcZxYE
Scott Byrns
Point Cloud in Java http://www.youtube.com/watch?v=oIyTCvi-XSI
Poor-mans Object Tracking in Java http://www.screencast.com/users/mscottb/folders/Jing/media/fca9fb5e-2053-4614-b1f6-047ebbd4a8ad
Ben X Tan
Actually...this isn't using OpenKinect. I'm using CL NUI at the moment which is in C#, but I will switch over to libfreenect c++ version on Mac soon...
- Midi Controller
- v0.1 - http://www.youtube.com/watch?v=z1Wp0HEYxSg
- Midi controlling notes on the X and Y axis
- http://www.youtube.com/watch?v=-3-TA6URf9M - l14m333 using my code as a mouse controller
- http://www.youtube.com/watch?v=OilcNuX404o - TIM885885 using my program to play chinese music. Actually sounds musical!
- v0.2 - http://www.youtube.com/watch?v=fCQwNLKJlCU
- Now shows heat map and plays the C major scale in a 2 octave range. Will be configurable later.
- v0.3 - No video yet, but I just got it to talk to Ableton Live!
- v0.1 - http://www.youtube.com/watch?v=z1Wp0HEYxSg
Jean-Marc Pelletier - Nenad Popov - Andrew Roth
jit.freenect.grab: A Max/Jitter external to grab data from the Kinect.
http://jmpelletier.com/freenect/
https://github.com/jmpelletier/jit.freenect.grab
http://www.youtube.com/watch?v=WIJA46ocia0
http://www.youtube.com/watch?v=wS8wyIYn77w
Phillipp Robbel
Early experiments with a Microsoft Kinect depth camera on a mobile robot base http://www.youtube.com/watch?v=dRPEns8MS2o
Jasper Brekelmans
Kinect 3D PointCloud Scanner http://www.youtube.com/watch?v=bZi-1NmQAGM&feature=player_embedded
Thomas Hansen
Segmenting point cloud pixels based on depth ranges http://vimeo.com/17085043
Preston Holmes (ptone)
Control of DMX based lighting via Kinect http://www.youtube.com/watch?v=Kg0Rvj-Seto
Controlling GarageBand: http://www.youtube.com/watch?v=u2-e9YMdadE
Peter Nash (pedronash)
Playing around with Processing and Java - seeing what's fun. My experience so far is mostly in smart calibration. http://www.youtube.com/watch?v=2lF8OJoWogY
Willow Garage
Several projects including multiple kinect integration and teleoperation of robots. Read more at http://www.willowgarage.com/blog/2010/11/22/kinect-ros-moving-forward-quickly video: http://www.youtube.com/watch?v=rYUFu64VXkg
Henry Chu
Reflection - art exhibit Interacting with a three-second delayed shadow of yourself
http://vimeo.com/16959492
http://vimeo.com/17040999
Parag K Mital
Sound modulating point clouds:
CADET
- Making opensource engine 2Real for fullbody interaction and mixed reality applications
- Kinect Generative Game Prototype http://www.vimeo.com/17135419
- Kinect skeleton library first baby steps http://www.vimeo.com/17220351 (we just started)
- Center for Advances in Digital Entertainment Technologies http://www.cadet.at
Achim Kern
Quick test using Kinect to control a digital pin-board in TouchDesigner. http://vimeo.com/17211596
John Stowers
Dongchul Kim (T9T9)
- 3D Cube Clouds http://www.youtube.com/watch?v=_rIV3FMbekM
- Hand Printing http://www.youtube.com/watch?v=9XwPpTOPY8k
- openKinect group in Korea, http://openKinect.co.kr
Integration in MRPT: Very simple visual SLAM
Part 1: Example code for how to grab Kinect observations, do multi-threading, convert range data to a 3D point cloud and render in real-time. More info here.
Part 2: Very simple demonstration of how to grab Kinect observations, perform visual feature tracking and build a 3D map (SLAM). More info here.
Kinect running a website
First Kinect compatible website http://www.youtube.com/watch?v=1QjYIrNWxks
Martin Kaltenbrunner
TuioKinect tracks simple hand gestures using the Kinect controller and sends control data based on the TUIO protocol. This is a preliminary proof of concept implementation, which still needs several improvements to become fully usable. Nevertheless it should work out of the box with most TUIO client applications. You can download the source code and a mac binary from its project page
The Therenect is a virtual Theremin, which defines two virtual antenna points that allow controlling the pitch and volume of a simple oscillator. The distance to these points can be controlled by freely moving the hand in three dimensions or by reshaping the hand, which allows gestures that should be quite similar to playing an actual Theremin.