Notice: MediaWiki has been updated. Report any rough edges to marcan@marcan.st

Project ideas

From OpenKinect
Revision as of 00:04, 14 December 2010 by Seankean (talk | contribs)
Jump to: navigation, search

Voxel TV System: Infinite perspective 3D Movie Capture, Editing, and Playback Ecosystem - Sean Kean

  • Portable rig for recording 3d point cloud data with multiple Kinects tethered to a laptop for storage with an iPhone for gyroscopic/gps metadata and controls.
  • Editing system for cutting together a narrative movie with video voxel point cloud data and setting directoral camera perspectives for playback
  • Playback system allowing viewer to change their perspective by navigating within the scene's point cloud data as it plays back - module for viewing with anaglyph or shutter glasses for use with 3D ready flatscreen TVs
  • Construction of physical volumetric displays for reconstructing 3d scene geometry on a cubic grid of LEDs - lights illuminated from kinect point cloud data playback


3D Drum Kit - Ben X Tan

  • Using MIDI so you can alter the sound to what ever you want
  • Placements of drums will be configurable too
  • Use physical objects as the drum components (Mark Esthers idea as discussed this morning with me :))
    • This way you can actually hit physical objects
    • You tell the software whether the object is a Tom, snare, kick, hat, etc. and then you can move it around in 3d space.
    • For example you set up a room with card board boxes and trash cans with AR markers on top of each object and you tap on them (next to and not on top of the markers) Or you might not even need markers...just use object detection by shape and size.


Gesture Based Key Mapping - Brian Schiesl

  • Using a full body skeleton to map a gesture and bind it to a single key press or a string of key presses.
  • Along with a key press it would also need to have a programmable gesture (toggle on/off) that would have the mouse track a hand.
  • Ability to "record" a gesture and then bind that gesture accordingly.
  • With it being full body it would need some gesture to start/stop the "recording" of the gesture.
  • This would allow gamers to feel more like the actual character in a game as well as allow non gamers the ability to control their computer with their own set of gestures.


Mouse Driver - Farid Wardan (http://far.id.au/)

  • Recreation of the native Kinect menu interface on xbox
  • Map hand movement to the mouse cursor
  • Gestures for clicking and right-clicking

video conferencing - Chris Duncanson-Hales

  • utilize camera's voice recognition and tracking capability for video conferencing with multiple participants
  • I am organizing an international conference with no travel budget. Having Kinects at each table group would increase the number of participants and would save literally 1000's of dollars (probably significantly more). The potential for international conference is staggering. At the last American Academy of Religion, the consultation I am a part of used Skype for a paper presentation. The presenter could not afford a cross continent air fare. This was the first use of this type of technology for the AAR. I'd like to push the envelope further with Kinects.

3D Scanner - nikione

  • Easiest/simplest way to use Kinect to scan an object in 3D
  • Software could be coupled for interfacing with one of the many RapProt or 3D Printers around (many opensource) effectively creating a "3D copier"


Sign Language Interpreter - Per Arneng

  • Sign Language to speech
  • Sign Language to text
  • An chat application so that sign language speakers can chat with non sign language speakers

Bodytracking for Weightlifting

  • Software analyzes angle of extremities to each other, records for later analysis
  • Overlay of actual movement on optimal bio-mechanical movement
  • Possible correction cues via speech output (Example: "Go further down", "Straighten your back", etc.)
  • Workout stats: Average declining speed, average lifting speed, uncontrolled movements (e.g. shaking knees)