Nothing - Final Prototyping

High-level Description:

Breaking the walls between two spaces, either culturally and/or physically, to explore nonverbal communication through gestures, signals and actions.

Detailed Description:

We are exploring communication between two people who are sharing a simulated table, but occupying two different spaces. How do they unintentionally influence the other’s experience when they can’t speak and may not be able to see and hear the results themselves? We’ll project each person into the space of the other, creating the illusion of a complete round table while in actuality keeping them separate and creating a speech barrier. Through the use of the kinect (and possibly specific object triggers) we will be tracking their gestures and actions to use as triggers for sound and light changes in the other room. We will not tell them ahead of time the effects of their gestures, and they will be able to explore the space and attempt to interact with the other person sharing their table.

Group: Lindsey Daniels, Chris Hall, Akmyrat Tuyliyev

Location: Meeting Room (room reservation requested) + Micro Studio (waiting on ability of booking)

Prototyping:

We started working this weekend to see if we can portray an individual sitting at the same table as you through the illusion of projection.  We are thinking of making the table a circular one that we will build out of wood.

18083849_10154433442257927_1093879134_o.jpg
18090700_10154433442287927_1807341552_o.jpg
18110956_10154433442217927_1869423443_o.jpg
18111268_10154433442337927_1962158828_o.jpg

We just tapped out the what the table would look to to test the projection.

18110270_10154433442232927_1431353603_o.jpg
18090671_10154433442177927_1388872824_o.jpg

Using Isadora, we captured me at the one table and projected the capture at the second table location.

This week, we will start working with the Kinect 2 to track  the non-verbal gestures of the individuals.

Interactions to track:

Y- Movement

X-movement

z-movement

  1. Arms in same plane- nothing happening
  2. arm and hand at 90 degrees
  3. Hand with fist - unfriendly sound
  4. Hand waving - friendly sound
  5. Hand touching face
  6. Hands touching wall- dimming light
  7. Side to side body movement / lean- changes color
  8. Hand on chin- crickets
  9. Object movement- songs played
  10. Two hands up- applause
  11. Hands coming together/clap-
  12. Smiling
  13. Other simple facial gestures

Kinect Tutorial for reference:

 

http://pterneas.com/2014/01/27/implementing-kinect-gestures/

Equipment/Props needed for installation:

2 sets of Speakers

2 Kinect 2s

2 big projectors

6 speed rails /table legs

2 hue bulbs & bridge

2 MSIs (can be the thin ones)

2 webcams

Lamps for both room

Plant

2 table cloths

Table tops