My final project for Physical Computing and Intro to Computational Media was an interactive film that I worked on with Jina Jung called Dating Stories.
We are handing over the reins in the medium of storytelling to the observer by asking them to choose the direction of a first date. - Creators
Description
This interactive film is a comedic, 'choose your own adventure’-style narrative directed towards adults. The lead actress in the film, Christine, has two choices from her search on a popular dating app: will she go on a date with Douglas or Jared? Ultimately the individual observer gets to decide. By using the physical, interactive board, the observer has the ability to choose what path the date goes on in the film by moving the wooden piece from node to node. Their choices and full narrative are executed on the screen.
Process
What I learned from user testing:
We didn't initially have a signal for the 'start' state on the board. This confused some people because they didn't know if their action had an effect when they put the wooden piece on the board. Originally, the first video started playing when the individual put the wooden piece on start, but there was no response on the actual board informing the individuals that they were doing to correct interaction. So after the user testing, a week before the project was due, we implementing a pulsing glow of the two LEDs around the start node that disappeared when you placed the wooden piece on start. We also cut the first scene down so that the first choice happens almost immediately after the user puts the wooden piece on start so that they understand from the first second how they are to interact with the board.
When the user is to choose a path, on the screen there is a split screen of the two options, and the two paths light up indicating that the film and board are waiting for their selection. This feature was very successful in user testung and really informed the user as to when they were to interact.
Final Code hosted on Github
Here are some visuals from how we created the project:
Building the board
This was my original rough sketch of how I thought the board might look like (without images)
With the image in mind above, Jina created this map for our board to be printed on acrylic
We ended up cutting two acrylic surfaces: 1) to hold the magnetic sensors and neopixel LED strips and one board that would go on top as a face plate. Are first attempt at laser cutting the board didn't work, so we used it as the board to hold the sensors
We had to also add some wood to support this sensor plate
We decide to velcro the arduino and board to the bottom of the acrylic sensor plate. This below image is that plate flipped over
This is what the sensor plate looks like from above, with the magnetic sensors. This was before we added the LED strips. They would go on top of where the paths are shown here. The holes helped to direct where each LED should be so that they can be seen in the top plate.
We put at magnet in the base of the wooden piece so that when it was placed on a node, the sensor would send the signal via serial communication to p5.js.
Shooting the film
Here are the short boards I wrote for the film:
Image + Storyboard for Jared Scenario
Image + Storyboard for Douglas Scenario
We shot the entire film, which included seven different endings in an 8 hour shoot. Here are some stills from the day:
Programming the board and the media in the browser
Here is my ICM post that talks a little bit more about my experience with the coding side of the project.
There was serial communication from the arduino to p5.js and back to the arduino which was something I haven't done before. I learned a lot of new things while creating this project. Including how to think through and break down the code into small chunks to be able to create your desired effect. This isn't something we really go over in class, so I am happy that I am starting to get an intuition for this.
We submitted our project to ITP's Winter Show.
On the second day of the show, I was interested in seeing some of the statistics of what path people decided on more often. I attached Mixpanel, an analytics platform and a company I used to work for, to see what paths viewers most often took. On the second day, the Winter Show was a four hour event. We had 80 people watch the film (according to the analytics). Below describes what paths were the most popular:
With 20%, the most popular ending was when Jared forgets his wallet and Christine has the pick up the tab after he drinks more than his fair share of beers.
Jared: Oh shoot... I think I forgot my wallet. Do you think they take Venmo?
Christine: You forgot your wallet? Don't worry, I got it. <she walks away with the check>
Jared: I can Venmo you?
<Christine continues to walk away, not acknowledging his comment>