Notice: MediaWiki has been updated. Report any rough edges to marcan@marcan.st

Gallery

From OpenKinect
Revision as of 08:15, 20 February 2011 by BankP (talk | contribs)
Jump to: navigation, search

This page collects videos of various people doing tests and experiments with OpenKinect software, and Kinect themed websites:

Kinect Themed Sites

Demos

3D Depth Sculpting using copies of my own body and other objects

  • I became intrigued with the possibility of sculpting in 3D using the Kinect by periodically recording the nearest object to the camera in each part of the image. By taking multiple 3D snapshots at different times and then merging them to show the closest object, I can create a 3D sculpture that I can walk through. Here I merge multiple 3D video streams. http://www.youtube.com/watch?v=LKjzbyBpkM8
  • Here I use a "depth strobe", where I grab snapshots 1-2x a second.

People Detection

Florian Echtler (floemuc)

Pete & Matt

okreylos

koabi's work

Diarmuid Wrenne diarmuid@bluekulu.com

  • A second version of the green screen demo. This one does movies too.
  • Extracting rotation data from real objects and mapping that to new virtual ones. Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism. http://www.youtube.com/watch?v=bO3YwW3WajI
  • Driving Quake Live with a kinect. It uses openkinect, python bindings and web.py on the linux to expose nearest point data. The imac runs Quake and a custom java program that calls the linux web server. It uses java.awt.Robot to generate mouse and key stroke events. http://www.youtube.com/watch?v=uvP2u2yOcNw Sorry about the resolution but I'll try to upload a better one later.
  • Extracting rotation data from real objects and mapping that to new virtual ones. Shows how I can extract the rotation of objects seen by the kinect and use that rotation to change the orientation of virtual objects within the Box2d space to create a virtual bat out of a real one!!. Notice that I have mirrored the color video stream so that it acts more like a mirror than a web cam so that I can overlay the 2d graphics onto the camera images for more realism. http://www.youtube.com/watch?v=bO3YwW3WajI
  • Openframeworks, box2d, opencv and ofxkinect. This uses the depth map to determine the closest point to the kinect. It uses this point to draw a line that is part of the box2d world. This line can then be moved around by moving your hand or a magic wand (in my case a roll of string!!) so that other objects with in the 2d world can be manipulated. Works well. http://www.youtube.com/watch?v=pR46sXjEtzE
  • Openframeworks, Box2d and opencv. Uses the blobs generated by opencv contours to generate a box2d object to manibulate other box2d objects. Works OK but filtering the blobs is quite error prone http://www.youtube.com/watch?v=NlrKcpUPtwM

Kyle point cloud viewer

cclaan

yankeyan

Memo Akten

L14M333

arne_

Full image of the IR dot field:

kode80apps

James Patten

cruxphotography

Daniel Reetz

Removing the IR cut filter from your camera and examining the Kinect IR field, including high res image:

Emily Gobeille - Theo Watson

DustyDingo

Two Kinects facing same direction, experiments:

Rolling shutter experiments:

The top image is a plain kinect, the other one has a rolling shuter in front of the laser projector. Both kinect operate at the same time.

Holding the kinect automatically on level:

Zephod / Stijn Kuipers

Zappadoc / URBI Implementation

netpro2k / Dominick D'Aniello

evoluce

marcan

imekinox

Eric Gradman (egradman)

Scott Byrns

Ben X Tan

Jean-Marc Pelletier - Nenad Popov - Andrew Roth

Phillipp Robbel

Jasper Brekelmans

Thomas Hansen

Preston Holmes (ptone)

Peter Nash (pedronash)

Willow Garage

Henry Chu

Parag K Mital

CADET

  • Making opensource engine 2Real for fullbody interaction and mixed reality applications. Kinect Generative Game Prototype http://www.vimeo.com/17135419

Achim Kern

John Stowers

Dongchul Kim (T9T9)

Integration in MRPT: Very simple visual SLAM

  • Part 1: Example code for how to grab Kinect observations, do multi-threading, convert range data to a 3D point cloud and render in real-time. More info here.
  • Part 2: Very simple demonstration of how to grab Kinect observations, perform visual feature tracking and build a 3D map (SLAM). More info here.

Kinect running a website

Martin Kaltenbrunner

  • TuioKinect tracks simple hand gestures using the Kinect controller and sends control data based on the TUIO protocol. This is a preliminary proof of concept implementation, which still needs several improvements to become fully usable. Nevertheless it should work out of the box with most TUIO client applications. You can download the source code and a mac binary from its page
  • The Therenect is a virtual Theremin, which defines two virtual antenna points that allow controlling the pitch and volume of a simple oscillator. The distance to these points can be controlled by freely moving the hand in three dimensions or by reshaping the hand, which allows gestures that should be quite similar to playing an actual Theremin.

Switch On The Code

  • Kinect getting started tutorial using libfreenect and the C# wrapper.
  • Demonstrates how to display the RBG data and depth data as a grayscale depth map.

http://www.switchonthecode.com/tutorials/kinect-tutorial-hacking-101

RGBDemo: 3D Scene Reconstruction and people tracking/height estimation

  • Freehand scanning of a room using image-based relative pose estimation.

Software available at http://nicolas.burrus.name/index.php/Research/KinectRgbDemoV4

GeckoSystems Mobile Robot

  • A GeckoSystems Carebot(tm) has been retrofitted with a pair of Kinects to improve data acquisition for it's autonomous navigation software GeckoNav.

3D Body Scan Using Multiple Kinects - Data and Interference Analysis

MikuMikuDance

  • MikuMikuDance is a free dance simulator that uses takes its own file format for 3d human characters, and performs a dance with it by editing the position of "bones" inside the model, frame by frame
  • It is a companion program to a nonfree singing text-to-speech program called Vocaloid
  • The later versions can match the 3d animated character's position to Kinect motion data

Gestural Interaction for Training Simulations

  • We used the Microsoft Kinect to create a simple free-handed interface for navigating a 3D world and performing triage.
  • We also developed a walking system for physical exertion.
  • We actually use the OpenNI software with the driver package provided by avin and the Unity wrapper provided by tinkerer.