Notice: MediaWiki has been updated. Report any rough edges to marcan@marcan.st

Difference between revisions of "Project ideas"

From OpenKinect
Jump to: navigation, search
Line 1: Line 1:
 
 
'''Live Dance perspective changer ''' - [[User:seankean| Sean Kean]]
 
'''Live Dance perspective changer ''' - [[User:seankean| Sean Kean]]
*I am in talks with a performance venue here in the city which has acrobats and other dancers as well as a gallery space. I'd like to set up an installation which displays both live and recorded "volumetric video" and allows viewers to experience the performances from traditionally impossible perspectives.  
+
*I am in talks with a performance venue here in new york city which has acrobats and other dancers as well as a gallery space. I'd like to set up an installation which displays both live and recorded "volumetric video" and allows viewers to experience the performances from traditionally impossible perspectives.  
  
  

Revision as of 19:40, 24 December 2010

Live Dance perspective changer - Sean Kean

  • I am in talks with a performance venue here in new york city which has acrobats and other dancers as well as a gallery space. I'd like to set up an installation which displays both live and recorded "volumetric video" and allows viewers to experience the performances from traditionally impossible perspectives.


Japanese Gameshow Human Tetris game


Floating Keyboard

  • Create a simple gesture for bringing up a "floating" typing keyboard
  • View would zoom in to user's face and upper torso
  • User would see the keyboard with opacity to see his hands and face "behind" the keyboard
  • Each "finger" press would really be a hand motion, a few inches movement rather than a couple centimeters.

Socratesone 20:47, 21 December 2010 (CET)

Voxel TV System: Infinite perspective 3D Movie Capture, Editing, and Playback Ecosystem - Sean Kean

  • Early experiments with the Kinect show a novel ability to record and manipulate 3D video - the Voxel TV system packages this ability in an end to end system with the goal of bringing this technology to the consumer market as the next generation of moviemaking
  • Portable rig for recording 3d point cloud data with multiple Kinects tethered to a laptop for storage with an iPhone for gyroscopic/gps metadata and controls.
  • Editing system for cutting together a narrative movie with video voxel point cloud data and setting directoral camera perspectives for playback - this likely involves novel development of a (intraframe?) compression algorithm for voxel/photomapped point cloud data at 30fps
  • Playback system allowing viewer to change their perspective by navigating within the scene's point cloud data as it plays back - module for viewing with anaglyph or shutter glasses for use with 3D ready flatscreen TVs
  • Construction of physical volumetric displays for reconstructing 3d scene geometry on a cubic grid of LEDs - lights illuminated from kinect point cloud data playback


3D Drum Kit - Ben X Tan

  • Using MIDI so you can alter the sound to what ever you want
  • Placements of drums will be configurable too
  • Use physical objects as the drum components (Mark Esthers idea as discussed this morning with me :))
    • This way you can actually hit physical objects
    • You tell the software whether the object is a Tom, snare, kick, hat, etc. and then you can move it around in 3d space.
    • For example you set up a room with card board boxes and trash cans with AR markers on top of each object and you tap on them (next to and not on top of the markers) Or you might not even need markers...just use object detection by shape and size.


Gesture Based Key Mapping - Brian Schiesl

  • Using a full body skeleton to map a gesture and bind it to a single key press or a string of key presses.
  • Along with a key press it would also need to have a programmable gesture (toggle on/off) that would have the mouse track a hand.
  • Record and Bind Gestures
  • gesture brings up start/stop/save interface
  • This would allow gamers to feel more like the actual character in a game as well as allow non gamers the ability to control their computer with their own set of gestures.
  • View visible representation of gesture, modify properties
  • Name gesture
  • Associate gesture with an application or trigger an event

Standardized Gesture Key Mapping

  • Sign language base of some gestures?
  • Painting interface:
    • shake up spray can gesture to bring up painting
    • left hand spins object 3-axis to be painted, right hand controls spray volume
    • shifting weight to one leg to scroll through items, pages, photos (further you lean, faster items are paged through)
    • Moving hand to chin to stroke beard(think) brings up options.


Gesture Semantics

  • identify multiple gestures in sequence ("combos")



Mouse Driver - Farid Wardan (http://far.id.au/)

  • Recreation of the native Kinect menu interface on xbox
  • Map hand movement to the mouse cursor
  • Gestures for clicking and right-clicking

video conferencing - Chris Duncanson-Hales

  • utilize camera's voice recognition and tracking capability for video conferencing with multiple participants
  • I am organizing an international conference with no travel budget. Having Kinects at each table group would increase the number of participants and would save literally 1000's of dollars (probably significantly more). The potential for international conference is staggering. At the last American Academy of Religion, the consultation I am a part of used Skype for a paper presentation. The presenter could not afford a cross continent air fare. This was the first use of this type of technology for the AAR. I'd like to push the envelope further with Kinects.

3D Scanner - nikione

  • Easiest/simplest way to use Kinect to scan an object in 3D
  • Software could be coupled for interfacing with one of the many RapProt or 3D Printers around (many opensource) effectively creating a "3D copier"


Sign Language Interpreter - Per Arneng

  • Sign Language to speech
  • Sign Language to text
  • An chat application so that sign language speakers can chat with non sign language speakers
  • Sign language-based programming language Socratesone 22:20, 21 December 2010 (CET)
  • Sign language-based operating system interface


Bodytracking for Weightlifting

  • Software analyzes angle of extremities to each other, records for later analysis
  • Overlay of actual movement on optimal bio-mechanical movement
  • Possible correction cues via speech output (Example: "Go further down", "Straighten your back", etc.)
  • Workout stats: Average declining speed, average lifting speed, uncontrolled movements (e.g. shaking knees)

Virtual Dance Pad for Rhythm games like DDR/StepMania - Waltbosz

  • Users would dance on a virtual dance pad being tracked by Kinect
  • Eliminate the need for cumbersome plastic dance pads that slip on floor and stick to feet.
  • Inspired by the Kinect piano by Pete & Matt