Notice: MediaWiki has been updated. Report any rough edges to marcan@marcan.st

Difference between revisions of "Gallery"

From OpenKinect
Jump to: navigation, search
m (Demos - Page 1)
 
(21 intermediate revisions by 11 users not shown)
Line 1: Line 1:
This page collects videos of various people doing tests and experiments with OpenKinect software.
+
This page collects videos of various people doing tests and experiments with OpenKinect software, and Kinect themed websites:
  
=== Gestural Interaction for Training Simulations ===
+
==Kinect Themed Sites==
  
We used the Microsoft Kinect to create a simple free-handed interface for navigating a 3D world and performing triage. We also developed a walking system for physical exertion.
+
* http://www.reddit.com/r/openkinect OpenKinect news and discussion community
 +
* http://www.kinecthacks.com - KinectHacks.com - Source for Kinect hacking community news, walkthroughs and downloads
 +
* http://kinect-hacks.net - Kinect Hacks, news, gossip and videos
 +
* http://www.kinectHacks.net - Kinect hacking blog and forum
 +
* http://www.freenect.com - Kinect hacking news
 +
* http://www.modmykinect.com - The innovation begins.
 +
* http://www.Bodensee-Deal.de - Kinect hacking news in German
 +
* http://www.kinectxbox360.es - Novedades, hacks y juegos de kinect en español.
 +
* http://www.kinectHacks.nl - Dutch Kinect hacking blog and forum
 +
* http://live4d.de/index.php?/XBox-360-Kinect-Sensor-Hacks-Blog/Kinect-Sensor-Hacks-News/ - German site
  
We actually use the OpenNI software with the driver package provided by avin and the Unity wrapper provided by tinkerer.
+
== Demos - Page 1 ==
{{#ev:youtube| -lLCu22INT8}}
+
=== Augmented Reality, Smart Glasses and 2 MS Kinects using 3GearSystem and OpenKinect ===
http://www.youtube.com/watch?v=-lLCu22INT8
+
{|
 +
|{{#ev:youtube|8FggsGUK5iA|320}}
 +
|valign="top"|
 +
* Uses 2 x MS Kinect using 3GearSystem on top of OpenKinect drivers for hand tracking
 +
* Maps hand tracking to RGB world using RGB cameras
 +
* Co ordinates augmented reality and hand tracking from kinects
 +
* Allows for 3D hand pinch and 3D multi hand actions such as pinch to zoom in 3D
 +
|}
 +
=== 3D Facial Performance Capture using Kinect ===
 +
{|
 +
|{{#ev:youtube|nYsqNnDA1l4|320}}
 +
|valign="top"|
 +
* Using the Kinect to capture data (green) of a markerless moving face (distance about 1 m, very limited coverage)
 +
* Mapping the rigid and non-rigid face motion to an animatable 3D face model (purple)
 +
* No use of the color information yet
 +
|}
 +
 
 +
=== Blink Solution brings Vodafone 3g’s Super Zoozoo to life ===
 +
{|
 +
|{{#ev:youtube|7AsbEnWYiDw|320}}
 +
|valign="top"|
 +
* What do you get when you combine Super Zoozoo with a Microsoft Kinect, an awesome programmer, a digital artist, a creative genius and some kick ass visuals??
 +
* Thanks to Blink Solution’s hunger for experimentation and a desire to stretch the boundaries of  technology and art, we bring you this video. http://digitalanalog.in/2011/03/25/blink-solution-brings-vodafone-3gs-super-zoozoo-to-life/
 +
|}
  
 
=== 3D Depth Sculpting using copies of my own body and other objects ===
 
=== 3D Depth Sculpting using copies of my own body and other objects ===
  
I became intrigued with the possibility of sculpting in 3D using the  
+
{|
Kinect by periodically recording the nearest object to the camera in  
+
|{{#ev:youtube|LKjzbyBpkM8|320}}
each part of the image. By taking multiple 3D snapshots at different  
+
|valign="top"|
times and then merging them to show the closest object, I can create a  
+
* I became intrigued with the possibility of sculpting in 3D using the Kinect by periodically recording the nearest object to the camera in each part of the image. By taking multiple 3D snapshots at different times and then merging them to show the closest object, I can create a 3D sculpture that I can walk through. Here I merge multiple 3D video streams. http://www.youtube.com/watch?v=LKjzbyBpkM8
3D sculpture that I can walk through.  
+
|-
 
+
|{{#ev:youtube|inim0xWiR0o|320}}
 
+
|valign="top"|
Here I merge multiple 3D video streams
+
* Here I use a "depth strobe", where I grab snapshots 1-2x a second.
{{#ev:youtube| LKjzbyBpkM8}}
+
|-
http://www.youtube.com/watch?v=LKjzbyBpkM8
+
|{{#ev:youtube|abS7G5ZT17c|320}}
 
+
|valign="top"|
 
+
* Here I take a single snapshot with some furniture and then remove it, allowing me to wander through the ghost of the furniture. http://www.youtube.com/watch?v=abS7G5ZT17c
Here I use a "depth strobe", where I grab snapshots 1-2x a second  
+
|-
{{#ev:youtube| inim0xWiR0o}}
+
|{{#ev:youtube|rBLYsB9BBSk|320}}
http://www.youtube.com/watch?v=inim0xWiR0o
+
|valign="top"|
 
+
* Here I update the 3D background continuously, creating a slur of objects. http://www.youtube.com/watch?v=rBLYsB9BBSk. Created in Python using the Python wrapper.
 
+
|}
Here I take a single snapshot with some furniture and then remove it,  
 
allowing me to wander through the ghost of the furniture:
 
{{#ev:youtube| abS7G5ZT17c}}
 
http://www.youtube.com/watch?v=abS7G5ZT17c  
 
 
 
 
 
Here I update the 3D background continuously, creating a slur of  
 
objects:
 
{{#ev:youtube| rBLYsB9BBSk}}
 
http://www.youtube.com/watch?v=rBLYsB9BBSk  
 
 
 
Created in Python using the Python wrapper.
 
  
 
=== People Detection ===
 
=== People Detection ===
Real-time people detection using two kinect
+
{|
{{#ev:youtube| x--xlKWBTAE}}
+
|{{#ev:youtube|x--xlKWBTAE|320}}
http://www.youtube.com/watch?v=x--xlKWBTAE
+
|valign="top"|
 +
* Real-time people detection using two kinect. http://www.youtube.com/watch?v=x--xlKWBTAE
 +
|}
  
 
=== Florian Echtler (floemuc) ===
 
=== Florian Echtler (floemuc) ===
"Multi-touch" interactions http://www.youtube.com/watch?v=ho6Yhz21BJI
 
  
Created with the libTISCH multitouch library: http://tisch.sf.net/
+
{|
 
+
|{{#ev:youtube|ho6Yhz21BJI|320}}
{{#ev:youtube|ho6Yhz21BJI}}
+
|valign="top"|
 +
* "Multi-touch" interactions http://www.youtube.com/watch?v=ho6Yhz21BJI Created with the libTISCH multitouch library: http://tisch.sf.net/
 +
|}
  
 
=== Pete & Matt ===
 
=== Pete & Matt ===
Fun with a "Kinect piano"!
 
  
A vastly improved piano:
+
{|
http://www.youtube.com/watch?v=VgLp-KyK5g8
+
|{{#ev:youtube|a0mdgdQfa-Q|320}}
{{#ev:youtube|VgLp-KyK5g8}}
+
|valign="top"|
 +
* Fun with a "Kinect piano"! A vastly improved piano: http://www.youtube.com/watch?v=a0mdgdQfa-Q
 +
|-
 +
||{{#ev:youtube|ppHcj15LypM|320}}
 +
|valign="top"|
 +
* Original version for posterity: http://www.youtube.com/watch?v=ppHcj15LypM
 +
|}
  
 +
=== okreylos ===
  
(Original version for posterity:)
+
{|
http://www.youtube.com/watch?v=ppHcj15LypM
+
|{{#ev:youtube|7QrnwoO1-8A|320}}
{{#ev:youtube|ppHcj15LypM}}
+
|valign="top"|
 
+
* 3D depth video capture http://www.youtube.com/watch?v=7QrnwoO1-8A measuring objects in 3D http://idav.ucdavis.edu/~okreylos/ResDev/Kinect/
=== okreylos ===
+
|}
3D depth video capture http://www.youtube.com/watch?v=7QrnwoO1-8A
 
measuring objects in 3D http://idav.ucdavis.edu/~okreylos/ResDev/Kinect/
 
  
 
=== koabi's work ===
 
=== koabi's work ===
http://www.youtube.com/profile?user=DerKorb#g/u
+
* http://www.youtube.com/profile?user=DerKorb#g/u
 
 
  
 
=== Diarmuid Wrenne diarmuid@bluekulu.com ===
 
=== Diarmuid Wrenne diarmuid@bluekulu.com ===
  
A second version of the green screen demo. This one does movies too.
+
{|
 +
|{{#ev:youtube|7QrnwoO1-8A|320}}
 +
|valign="top"|
 +
* 3D depth video capture http://www.youtube.com/watch?v=7QrnwoO1-8A measuring objects in 3D http://idav.ucdavis.edu/~okreylos/ResDev/Kinect/
 +
|-
 +
|{{#ev:youtube|qy7lKS6L75w|320}}
 +
|valign="top"|
 +
* A second version of the green screen demo. This one does movies too.
 +
|-
 +
|{{#ev:youtube|4yp37U-YHv4|320}}
 +
|valign="top"|
 +
* 3D point cloud rendered with boxes with scaling. Also superimposing 3d models into the scene (a rifle of course). Also using OSC from an ipad to control the scene. http://www.youtube.com/watch?v=4yp37U-YHv4
 +
|-
 +
|{{#ev:youtube|T8bkAQ-VxXg|320}}
 +
|valign="top"|
 +
* 3D Point cloud viewer. http://www.youtube.com/watch?v=T8bkAQ-VxXg
 +
|-
 +
|{{#ev:youtube|bO3YwW3WajI|320}}
 +
|valign="top"|
 +
* Extracting rotation data from real objects and mapping that to new virtual ones. Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism. http://www.youtube.com/watch?v=bO3YwW3WajI
 +
|-
 +
|{{#ev:youtube|uvP2u2yOcNw|320}}
 +
|valign="top"|
 +
* Driving Quake Live with a kinect. It uses openkinect, python bindings and web.py on the linux to expose nearest point data. The imac runs Quake and a custom java program that calls the linux web server. It uses java.awt.Robot to generate mouse and key stroke events. http://www.youtube.com/watch?v=uvP2u2yOcNw Sorry about the resolution but I'll try to upload a better one later.
 +
|-
 +
|{{#ev:youtube|bO3YwW3WajI|320}}
 +
|valign="top"|
 +
* Extracting rotation data from real objects and mapping that to new virtual ones. Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism. http://www.youtube.com/watch?v=bO3YwW3WajI
 +
|-
 +
|{{#ev:youtube|pR46sXjEtzE|320}}
 +
|valign="top"|
 +
* Openframeworks, box2d, opencv and ofxkinect. This uses the depth map to determine the closest point to the kinect. It uses this point to draw a line that is part of the box2d world. This line can then be moved around by moving your hand or a magic wand (in my case a roll of string!!) so that other objects with in the 2d world can be manipulated. Works well. http://www.youtube.com/watch?v=pR46sXjEtzE
 +
|-
 +
|{{#ev:youtube|NlrKcpUPtwM|320}}
 +
|valign="top"|
 +
* Openframeworks, Box2d and opencv. Uses the blobs generated by opencv contours to generate a box2d object to manibulate other box2d objects. Works OK but filtering the blobs is quite error prone http://www.youtube.com/watch?v=NlrKcpUPtwM
 +
|-
 +
|{{#ev:youtube|PYq9gkdpiS8|320}}
 +
|valign="top"|
 +
* Using web.py to web enable a kinect on linux. http://www.youtube.com/watch?v=PYq9gkdpiS8
 +
|}
  
{{#ev:youtube|qy7lKS6L75w}}
+
=== Kyle point cloud viewer ===
  
3D point cloud rendered with boxes with scaling
+
* Initial render in processing: http://www.flickr.com/photos/kylemcdonald/5167174610/
 +
* Viewer substituting glview.c: http://www.openframeworks.cc/forum/viewtopic.php?p=24884#p24884
 +
* advanced viewer with DOF using ofxKinect: http://www.openframeworks.cc/forum/viewtopic.php?p=24958#p24958
  
Also superimposing 3d models into the scene (a rifle of course)
+
=== cclaan ===
 
 
Also using OSC from an ipad to control the scene
 
{{#ev:youtube|4yp37U-YHv4}}
 
 
 
http://www.youtube.com/watch?v=4yp37U-YHv4
 
 
 
3D Point cloud viewer
 
http://www.youtube.com/watch?v=T8bkAQ-VxXg
 
{{#ev:youtube|T8bkAQ-VxXg}}
 
 
 
Extracting rotation data from real objects and mapping that to new virtual ones.
 
 
 
http://www.youtube.com/watch?v=bO3YwW3WajI
 
{{#ev:youtube|bO3YwW3WajI}}
 
 
 
Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. 
 
 
 
Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism.
 
 
 
Driving Quake Live with a kinect
 
 
 
http://www.youtube.com/watch?v=uvP2u2yOcNw
 
{{#ev:youtube|uvP2u2yOcNw}}
 
It uses openkinect, python bindings and web.py on the linux to expose nearest point data. The imac runs Quake and a custom java program that calls the linux web server. It uses java.awt.Robot to generate mouse and key stroke events.
 
 
 
Sorry about the resolution but I'll try to upload a better one later.
 
 
 
 
 
Openframeworks, box2d, opencv and ofxkinect
 
 
 
This uses the depth map to determine the closest point to the kinect. It uses this point to draw a line that is part of the box2d world. This line can then be moved around by moving your hand or a magic wand (in my case a roll of string!!) so that other objects with in the 2d world can be manipulated. Works well.
 
http://www.youtube.com/watch?v=pR46sXjEtzE
 
 
 
Openframeworks, Box2d and opencv
 
 
 
Uses the blobs generated by opencv contours to generate a box2d object to manibulate other box2d objects. Works OK but filtering the blobs is quite error prone
 
http://www.youtube.com/watch?v=NlrKcpUPtwM
 
 
 
Using web.py to web enable a kinect on linux.
 
http://www.youtube.com/watch?v=PYq9gkdpiS8
 
 
 
=== Kyle point cloud viewer ===
 
initial render in processing: http://www.flickr.com/photos/kylemcdonald/5167174610/
 
  
viewer substituting glview.c: http://www.openframeworks.cc/forum/viewtopic.php?p=24884#p24884
+
{|
 +
|{{#ev:vimeo|16788233|320}}
 +
|valign="top"|
 +
* Point cloud plus color. http://vimeo.com/16788233
 +
|}
  
advanced viewer with DOF using ofxKinect: http://www.openframeworks.cc/forum/viewtopic.php?p=24958#p24958
+
{|
 +
|{{#ev:vimeo|25852368|320}}
 +
|valign="top"|
 +
* 3d Augmented Reality Video on iPad http://vimeo.com/25852368
 +
|}
  
=== cclaan ===
 
Point cloud plus color
 
http://vimeo.com/16788233
 
  
 
=== yankeyan ===
 
=== yankeyan ===
Awesome object recognition! http://www.youtube.com/watch?v=fQ59dXOo63o and http://www.youtube.com/watch?v=cRBozGoa69s
 
  
Lightsaber tracking and rendering http://www.youtube.com/watch?v=3EeJCln5KYg
+
{|
 +
|{{#ev:youtube|fQ59dXOo63o|320}}
 +
|valign="top"|
 +
* Awesome object recognition! http://www.youtube.com/watch?v=fQ59dXOo63o and http://www.youtube.com/watch?v=cRBozGoa69s
 +
|-
 +
|{{#ev:youtube|cRBozGoa69s|320}}
 +
|-
 +
|{{#ev:youtube|3EeJCln5KYg|320}}
 +
|valign="top"|
 +
* Lightsaber tracking and rendering http://www.youtube.com/watch?v=3EeJCln5KYg
 +
|}
  
 
=== Memo Akten ===
 
=== Memo Akten ===
Drawing in 3D http://vimeo.com/16818988
+
 
{{#ev:vimeo|16818988}}
+
{|
 +
|{{#ev:vimeo|16818988|320}}
 +
|valign="top"|
 +
* Drawing in 3D http://vimeo.com/16818988
 +
|}
  
 
=== L14M333 ===
 
=== L14M333 ===
Moving the motor with a GUI while showing video streams: http://www.youtube.com/watch?v=KsvQpUnlp-Y
 
  
Plotting accelerometer to graph and calibration http://www.youtube.com/watch?v=GWvcgZkADUU (Uses CL NUI (Will switch later))
+
{|
 +
|{{#ev:youtube|KsvQpUnlp-Y|320}}
 +
|valign="top"|
 +
* Moving the motor with a GUI while showing video streams: http://www.youtube.com/watch?v=KsvQpUnlp-Y
 +
|-
 +
|{{#ev:youtube|GWvcgZkADUU|320}}
 +
|valign="top"|
 +
* Plotting accelerometer to graph and calibration http://www.youtube.com/watch?v=GWvcgZkADUU (Uses CL NUI (Will switch later))
 +
|-
 +
|{{#ev:youtube|-3-TA6URf9M|320}}
 +
|valign="top"|
 +
* Using kinect as a mouse http://www.youtube.com/watch?v=-3-TA6URf9M (Uses CL NUI (Will switch later))
 +
|-
 +
|{{#ev:youtube|wBoVrZZlmJ0&|320}}
 +
|valign="top"|
 +
* Kinect used to control mouse (v2) with source: http://www.youtube.com/watch?v=wBoVrZZlmJ0&hd=1
 +
|-
 +
|{{#ev:youtube|tlHzqeIhDiQ|320}}
 +
|valign="top"|
 +
* Turning TV into touch screen TV using Kinect: http://www.youtube.com/watch?v=tlHzqeIhDiQ
 +
|-
 +
|{{#ev:youtube|JlwWp8ItCVA&|320}}
 +
|valign="top"|
 +
* Another KinectTouch demo improved source fully commented: http://www.youtube.com/watch?v=JlwWp8ItCVA&hd=1
 +
|}
  
Using kinect as a mouse http://www.youtube.com/watch?v=-3-TA6URf9M (Uses CL NUI (Will switch later))
+
* Single object detection and improved framerate: http://tinyurl.com/handtrack
 +
* Get latest source code of mine from: http://get.essexconsolerepairs.co.uk/kinecttouch
  
Kinect used to control mouse (v2) with source: http://www.youtube.com/watch?v=wBoVrZZlmJ0&hd=1
+
=== arne_ ===
 
 
Turning TV into touch screen TV using Kinect: http://www.youtube.com/watch?v=tlHzqeIhDiQ
 
 
 
Another KinectTouch demo improved source fully commented: http://www.youtube.com/watch?v=JlwWp8ItCVA&hd=1
 
 
 
Single object detection and improved framerate: http://tinyurl.com/handtrack
 
 
 
Get latest source code of mine from: http://get.essexconsolerepairs.co.uk/kinecttouch
 
  
=== arne_ ===
 
 
Full image of the IR dot field:
 
Full image of the IR dot field:
  
http://livingplace.informatik.haw-hamburg.de/blog/wp-content/uploads/2010/11/kinect1.png
+
* http://livingplace.informatik.haw-hamburg.de/blog/wp-content/uploads/2010/11/kinect1.png
  
 
=== kode80apps ===
 
=== kode80apps ===
Head tracking for 3D vision using OpenKinect software:
+
 
http://www.youtube.com/watch?v=Y-f_oMOvNAk
+
{|
http://www.youtube.com/watch?v=CddvvlP4UNM
+
|{{#ev:youtube|Y-f_oMOvNAk|320}}
 +
|valign="top"|
 +
* Head tracking for 3D vision using OpenKinect software. http://www.youtube.com/watch?v=Y-f_oMOvNAk  
 +
|-
 +
|{{#ev:youtube|CddvvlP4UNM|320}}
 +
|valign="top"|
 +
* http://www.youtube.com/watch?v=CddvvlP4UNM
 +
|}
  
 
=== James Patten ===
 
=== James Patten ===
Multitouch Tracking on arbitrary planes with Kinect http://www.youtube.com/watch?v=Bth0TkRLVtk
+
 
 +
{|
 +
|{{#ev:youtube|Bth0TkRLVtk|320}}
 +
|valign="top"|
 +
* Multitouch Tracking on arbitrary planes with Kinect http://www.youtube.com/watch?v=Bth0TkRLVtk
 +
|}
  
 
=== cruxphotography ===
 
=== cruxphotography ===
Box cloud http://www.youtube.com/watch?v=e8h6DL0Dc84
+
 
 +
{|
 +
|{{#ev:youtube|e8h6DL0Dc84|320}}
 +
|valign="top"|
 +
* Box cloud http://www.youtube.com/watch?v=e8h6DL0Dc84
 +
|}
  
 
=== Daniel Reetz ===
 
=== Daniel Reetz ===
 
Removing the IR cut filter from your camera and examining the Kinect IR field, including high res image:
 
Removing the IR cut filter from your camera and examining the Kinect IR field, including high res image:
http://www.futurepicture.org/?p=97
+
* http://www.futurepicture.org/?p=97
  
 
=== Emily Gobeille - Theo Watson ===
 
=== Emily Gobeille - Theo Watson ===
Digital puppetry with Kinect http://vimeo.com/16985224
+
 
{{#ev:vimeo|16985224}}
+
{|
 +
|{{#ev:vimeo|16985224|320}}
 +
|valign="top"|
 +
* Digital puppetry with Kinect http://vimeo.com/16985224
 +
|}
  
 
=== DustyDingo ===
 
=== DustyDingo ===
  
Two Kinects facing same direction, experiments:[http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction.png]
+
Two Kinects facing same direction, experiments:
[http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction_c_both.png]
+
* [http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction.png]
[http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction_c_single.png]
+
* [http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction_c_both.png]
 +
* [http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction_c_single.png]
  
 
Rolling shutter experiments:
 
Rolling shutter experiments:
Setup:
+
* Setup: http://atommuell.mum.jku.at/~aurel/kinect_roling_shuter_proto_2.jpg
http://atommuell.mum.jku.at/~aurel/kinect_roling_shuter_proto_2.jpg
 
  
 
The top image is a plain kinect, the other one has a rolling shuter in front of the laser projector.
 
The top image is a plain kinect, the other one has a rolling shuter in front of the laser projector.
 
Both kinect operate at the same time.
 
Both kinect operate at the same time.
http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction_c_both_one_proj_shutter.png
+
* http://atommuell.mum.jku.at/~aurel/two_kinects_same_direction_c_both_one_proj_shutter.png
  
 
Holding the kinect automatically on level:
 
Holding the kinect automatically on level:
[http://atommuell.mum.jku.at/~aurel/hold_level_short.avi]
+
* [http://atommuell.mum.jku.at/~aurel/hold_level_short.avi]
 
 
=== yoda-- ===
 
 
 
Fist detection http://yoda-jm.performous.org/freenect/in2.png
 
  
 
=== Zephod / Stijn Kuipers ===
 
=== Zephod / Stijn Kuipers ===
  
Windows RBG to Z Projection http://vimeo.com/17007842
+
{|
 
+
|{{#ev:vimeo|17007842|320}}
=== Zappadoc / URBI Implementation ===
+
|valign="top"|
 
+
* Windows RBG to Z Projection http://vimeo.com/17007842
URBI/Urbiscript implementation http://www.urbiforge.org/index.php/Modules/UKinect
+
|}
 
+
===Sebastian Frisch ===
=== netpro2k / Dominick D'Aniello ===
 
 
 
Quick background removal and parallax demo http://vimeo.com/17023522
 
 
 
3D object manipulation http://vimeo.com/17045326
 
{{#ev:vimeo|17045326}}
 
 
 
Kinect Kart http://vimeo.com/17075573
 
{{#ev:vimeo|17075573}}
 
 
 
=== evoluce ===
 
 
 
Controlling Windows 7 applications with Kinect http://www.youtube.com/watch?v=M-wLOfjVfVc
 
 
 
=== [[User:marcan|marcan]] ===
 
 
 
[http://www.youtube.com/watch?v=rKhW-cvpkks The video that started it all]<br />
 
[http://www.youtube.com/watch?v=Q1heqFVrQGU Laser projection on a moving surface in perspective, using the Kinect for tracking]
 
 
 
=== [[User:imekinox|imekinox]] ===
 
"AS3 first communication" http://www.youtube.com/watch?v=_9sDY6WO4mY
 
 
 
"AS3 second phase, motor & accelerometers" http://www.youtube.com/watch?v=SvfDvGaY348
 
 
 
"AS3 Very simple hand tracking" http://www.youtube.com/watch?v=yFy_NYcWDMk
 
 
 
"AS3 Multiple hand tracking" http://www.youtube.com/watch?v=HWIRSQuuqm0
 
 
 
=== Eric Gradman (egradman) ===
 
"Standard gravity" art project using libfreenect and python
 
http://www.youtube.com/watch?v=uaci4dcZxYE
 
 
 
=== Scott Byrns ===
 
Point Cloud in Java
 
http://www.youtube.com/watch?v=oIyTCvi-XSI
 
 
 
Poor-mans Object Tracking in Java
 
http://www.screencast.com/users/mscottb/folders/Jing/media/fca9fb5e-2053-4614-b1f6-047ebbd4a8ad
 
 
 
=== [[User:benxtan|Ben X Tan]] ===
 
Actually...this isn't using OpenKinect. I'm using CL NUI at the moment which is in C#, but I will switch over to libfreenect c++ version on Mac soon...
 
* Midi Controller
 
** v0.1 - http://www.youtube.com/watch?v=z1Wp0HEYxSg
 
*** Midi controlling notes on the X and Y axis
 
*** http://www.youtube.com/watch?v=-3-TA6URf9M - l14m333 using my code as a mouse controller
 
*** http://www.youtube.com/watch?v=OilcNuX404o - TIM885885 using my program to play chinese music. Actually sounds musical!
 
** v0.2 - http://www.youtube.com/watch?v=fCQwNLKJlCU
 
*** Now shows heat map and plays the C major scale in a 2 octave range. Will be configurable later.
 
** v0.3 - No video yet, but I just got it to talk to Ableton Live!
 
 
 
=== [[User:jmpelletier|Jean-Marc Pelletier]] - Nenad Popov - Andrew Roth ===
 
jit.freenect.grab: A Max/Jitter external to grab data from the Kinect.<br />
 
http://jmpelletier.com/freenect/ <br />
 
https://github.com/jmpelletier/jit.freenect.grab <br />
 
http://www.youtube.com/watch?v=WIJA46ocia0 <br />
 
http://www.youtube.com/watch?v=wS8wyIYn77w <br />
 
 
 
=== Phillipp Robbel ===
 
Early experiments with a Microsoft Kinect depth camera on a mobile robot base
 
http://www.youtube.com/watch?v=dRPEns8MS2o
 
 
 
=== Jasper Brekelmans ===
 
Kinect 3D PointCloud Scanner
 
http://www.youtube.com/watch?v=bZi-1NmQAGM&feature=player_embedded
 
 
 
=== Thomas Hansen ===
 
Segmenting point cloud pixels based on depth ranges
 
http://vimeo.com/17085043
 
{{#ev:vimeo|17085043}}
 
 
 
=== Preston Holmes (ptone) ===
 
Control of DMX based lighting via Kinect
 
http://www.youtube.com/watch?v=Kg0Rvj-Seto
 
 
 
Controlling GarageBand: http://www.youtube.com/watch?v=u2-e9YMdadE
 
 
 
=== Peter Nash (pedronash) ===
 
Playing around with Processing and Java - seeing what's fun. My experience so far is mostly in smart calibration.
 
http://www.youtube.com/watch?v=2lF8OJoWogY
 
 
 
=== Willow Garage ===
 
Several projects including multiple kinect integration and teleoperation of robots.  Read more at http://www.willowgarage.com/blog/2010/11/22/kinect-ros-moving-forward-quickly  video: http://www.youtube.com/watch?v=rYUFu64VXkg
 
 
 
=== Henry Chu ===
 
Reflection - art exhibit
 
Interacting with a three-second delayed shadow of yourself
 
 
 
http://vimeo.com/16959492<br />
 
http://vimeo.com/17040999
 
 
 
=== [[User:pkmital|Parag K Mital]] ===
 
Sound modulating point clouds:
 
 
 
http://vimeo.com/16964263
 
 
 
=== [[User:CADET|CADET]] ===
 
*Making opensource engine 2Real for fullbody interaction and mixed reality applications
 
*Kinect Generative Game Prototype http://www.vimeo.com/17135419
 
*Kinect skeleton library first baby steps http://www.vimeo.com/17220351 (we just started)
 
*Center for Advances in Digital Entertainment Technologies http://www.cadet.at
 
 
 
=== Achim Kern ===
 
Quick test using Kinect to control a digital pin-board in TouchDesigner.
 
http://vimeo.com/17211596
 
{{#ev:vimeo|17211596}}
 
 
 
=== [[User:nzjrs|John Stowers]] ===
 
{{#ev:youtube|4EGQZsu-kkk}}
 
 
 
=== Dongchul Kim ([[User:t9t9|T9T9]]) ===
 
{{#ev:youtube| _rIV3FMbekM}}
 
{{#ev:youtube| 9XwPpTOPY8k}}
 
*3D Cube Clouds http://www.youtube.com/watch?v=_rIV3FMbekM
 
*Hand Printing http://www.youtube.com/watch?v=9XwPpTOPY8k
 
*openKinect group in Korea, http://openKinect.co.kr
 
 
 
 
 
=== Integration in MRPT: Very simple visual SLAM ===
 
 
 
'''Part 1''': Example code for how to grab Kinect observations, do multi-threading, convert range data to a 3D point cloud and render in real-time. More info [http://www.mrpt.org/Kinect_and_MRPT here].
 
 
 
{{#ev:youtube|GLaPwKbrbIM}}
 
 
 
 
 
'''Part 2''': Very simple demonstration of how to grab Kinect observations, perform visual feature tracking and build a 3D map (SLAM). More info [http://www.mrpt.org/Kinect_and_MRPT here].
 
 
 
{{#ev:youtube|dGVnPvgqu3M}}
 
 
 
=== Kinect running a website ===
 
First Kinect compatible website http://www.youtube.com/watch?v=1QjYIrNWxks
 
 
 
 
 
=== Martin Kaltenbrunner ===
 
 
 
{{#ev:youtube|vZSEEnMP6pg}}
 
TuioKinect tracks simple hand gestures using the Kinect controller and sends control data based on the [http://tuio.org/ TUIO] protocol. This is a preliminary proof of concept implementation, which still needs several improvements to become fully usable. Nevertheless it should work out of the box with most TUIO client applications. You can download the source code and a mac binary from its [http://code.google.com/​p/​tuiokinect/​ project page]
 
 
 
{{#ev:youtube|DUCZ5L5Y578}}
 
The Therenect is a virtual Theremin, which defines two virtual antenna points that allow controlling the pitch and volume of a simple oscillator. The distance to these points can be controlled by freely moving the hand in three dimensions or by reshaping the hand, which allows gestures that should be quite similar to playing an actual Theremin.
 
 
 
=== Switch On The Code ===
 
Kinect getting started tutorial using libfreenect and the C# wrapper.  Demonstrates how to display the RBG data and depth data as a grayscale depth map.
 
  
http://www.switchonthecode.com/tutorials/kinect-tutorial-hacking-101
+
{|
 +
|{{#ev:vimeo|21247205|320}}
 +
|valign="top"|
 +
* Asteroids 3D. Interaction Game with ofxKinect and OpenCv http://vimeo.com/21247205
 +
|}
  
=== RGBDemo: 3D Scene Reconstruction and people tracking/height estimation ===
 
  
* Freehand scanning of a room using image-based relative pose estimation:
+
=== Kinect Earth ===
{{#ev:youtube|2ml8GiUPTao}}
 
  
* People detection with height estimation:
+
{|
http://www.youtube.com/watch?v=nnCDOKLuu0g
+
|{{#ev:vimeo|21563702|320}}
 +
|valign="top"|
 +
* Kinect Earth. Controlling Google Earth in a browser window with Kinect Core Vision http://vimeo.com/21563702
 +
|}
  
Software available at http://nicolas.burrus.name/index.php/Research/KinectRgbDemoV4
+
=== Kinect Juggle ===
  
=== GeckoSystems Mobile Robot ===
+
{|
 +
|{{#ev:youtube|9AXpnlkqPCI|320}}
 +
|valign="top"|
 +
* Virtual juggling with OpenNI http://www.youtube.com/watch?v=9AXpnlkqPCI
 +
* Source code: http://kinect-juggle.googlecode.com
 +
|}
  
{{#ev:youtube|kn93BS44Das}}
 
  
A GeckoSystems Carebot(tm) has been retrofitted with a pair of Kinects to improve data acquisition for it's autonomous navigation software GeckoNav.
+
=== Aquila 1.7b - iCub teleoperation ===
  
=====3D Body Scan Using Multiple Kinects - Data and Interference Analysis=====
+
{|
We simulated a full body scanner using data from 4 views
+
|{{#ev:youtube|JDKu4q6dr84|320}}
 +
|valign="top"|
 +
* Website: http://www.martinpeniak.com
 +
* Source code: http://sourceforge.net/projects/aquila/
 +
|}
  
http://www.youtube.com/watch?v=9MwS_nk9n2A
+
== Demos - Page 2 ==
 +
[[Gallery_2|Next Page]]

Latest revision as of 17:02, 28 November 2012

This page collects videos of various people doing tests and experiments with OpenKinect software, and Kinect themed websites:

Kinect Themed Sites

Demos - Page 1

Augmented Reality, Smart Glasses and 2 MS Kinects using 3GearSystem and OpenKinect

  • Uses 2 x MS Kinect using 3GearSystem on top of OpenKinect drivers for hand tracking
  • Maps hand tracking to RGB world using RGB cameras
  • Co ordinates augmented reality and hand tracking from kinects
  • Allows for 3D hand pinch and 3D multi hand actions such as pinch to zoom in 3D

3D Facial Performance Capture using Kinect

  • Using the Kinect to capture data (green) of a markerless moving face (distance about 1 m, very limited coverage)
  • Mapping the rigid and non-rigid face motion to an animatable 3D face model (purple)
  • No use of the color information yet

Blink Solution brings Vodafone 3g’s Super Zoozoo to life

3D Depth Sculpting using copies of my own body and other objects

  • I became intrigued with the possibility of sculpting in 3D using the Kinect by periodically recording the nearest object to the camera in each part of the image. By taking multiple 3D snapshots at different times and then merging them to show the closest object, I can create a 3D sculpture that I can walk through. Here I merge multiple 3D video streams. http://www.youtube.com/watch?v=LKjzbyBpkM8
  • Here I use a "depth strobe", where I grab snapshots 1-2x a second.

People Detection

Florian Echtler (floemuc)

Pete & Matt

okreylos

koabi's work

Diarmuid Wrenne diarmuid@bluekulu.com

  • A second version of the green screen demo. This one does movies too.
  • Extracting rotation data from real objects and mapping that to new virtual ones. Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism. http://www.youtube.com/watch?v=bO3YwW3WajI
  • Driving Quake Live with a kinect. It uses openkinect, python bindings and web.py on the linux to expose nearest point data. The imac runs Quake and a custom java program that calls the linux web server. It uses java.awt.Robot to generate mouse and key stroke events. http://www.youtube.com/watch?v=uvP2u2yOcNw Sorry about the resolution but I'll try to upload a better one later.
  • Extracting rotation data from real objects and mapping that to new virtual ones. Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism. http://www.youtube.com/watch?v=bO3YwW3WajI
  • Openframeworks, box2d, opencv and ofxkinect. This uses the depth map to determine the closest point to the kinect. It uses this point to draw a line that is part of the box2d world. This line can then be moved around by moving your hand or a magic wand (in my case a roll of string!!) so that other objects with in the 2d world can be manipulated. Works well. http://www.youtube.com/watch?v=pR46sXjEtzE
  • Openframeworks, Box2d and opencv. Uses the blobs generated by opencv contours to generate a box2d object to manibulate other box2d objects. Works OK but filtering the blobs is quite error prone http://www.youtube.com/watch?v=NlrKcpUPtwM

Kyle point cloud viewer

cclaan


yankeyan

Memo Akten

L14M333

arne_

Full image of the IR dot field:

kode80apps

James Patten

cruxphotography

Daniel Reetz

Removing the IR cut filter from your camera and examining the Kinect IR field, including high res image:

Emily Gobeille - Theo Watson

DustyDingo

Two Kinects facing same direction, experiments:

Rolling shutter experiments:

The top image is a plain kinect, the other one has a rolling shuter in front of the laser projector. Both kinect operate at the same time.

Holding the kinect automatically on level:

Zephod / Stijn Kuipers

Sebastian Frisch


Kinect Earth

Kinect Juggle


Aquila 1.7b - iCub teleoperation

Demos - Page 2

Next Page