EHO- Final Documentation (Lillian Korinek)

Title: Glitch.

Video with Interaction: Code attached below

Demo Video:

Demo Sound by Julia Myers:

What? Our final project consisted of a video made of still images played on loop. The video included images from the worst man-made environmental disasters in the last century (a full list of featured disasters can be found under references). In addition, idyllic images of the environment were sourced from A full list of names of photographers featured can also be found under references.

A “glitch” audio and visual effect was triggered when the user (Julia) interacted with the keyboard. Thus, the video was affected by human interaction, reflecting on the irreversible changes humans are creating in the environment.

Big Question: Are you humans in fact the “glitch” in Earth’s perfect and dynamic system?

Why? I am personally interested in man’s relationship with nature, and the line humanity draws between itself and the Earth. At what point do we consider nature something separate from ourselves? Humanity has had impacted the environment. We continue to pollute and abuse the Earth’s resources  despite the fact we are completely reliant on it and part of it. Is there a ‘glitch’ in humanity’s code that allows us to forget our intrinsic ties to the Earth?

How? The project will be constructed using Processing, Adobe Premiere, archived footage, and the Arduino (to construct the controller). Still images will be collected (a total of 400) from various environmental disasters that have occurred during the last century (a full list below). ‘Glitch Art’ effects ( will be produced using Processing, and triggered through an A-B Arduino controller.


Glitch Art:

Dead Plant as Input:

Environmental Justice Art:


Worst man-made environmental disasters in the last century:

Photographers featured: 

abigail-keenan adam-willoughby-knox-56406-unsplash.jpg ales-krivec-17906-unsplash.jpg ales-krivec-22059-unsplash.jpg ales-krivec-623992-unsplash.jpg alexandre-godreau-431567-unsplash.jpg anchor-lee-181398-unsplash.jpg andres-sanz-100047-unsplash.jpg anne-zwagers-558066-unsplash.jpg annie-spratt-365552-unsplash.jpg annie-spratt-370955-unsplash.jpg arne-smith-287394-unsplash.jpg arto-marttinen-250319-unsplash.jpg avel-chuklanov-18175-unsplash.jpg bailey-hall-447662-unsplash.jpg bas-de-korte-572422-unsplash.jpg bence-kiss-dobronyi-424467-unsplash.jpg bolun-yan-50041-unsplash.jpg caterina-sanders-397156-unsplash.jpg chris-leipelt-178133-unsplash.jpg chris-ried-586037-unsplash.jpg chris-ried-596259-unsplash.jpg christian-vasile-612302-unsplash.jpg christin-hume-588792-unsplash.jpg christoph-bengtsson-lissalde-80291-unsplash.jpg cindy-torres-79170-unsplash.jpg connor-robertson-334257-unsplash.jpg dan-the-drone-502328-unsplash.jpg darrin-henein-68371-unsplash (1).jpg darrin-henein-68371-unsplash.jpg david-clode-438752-unsplash.jpg david-marcu-569463-unsplash.jpg denisse-leon-438807-unsplash.jpg denisse-leon-487454-unsplash.jpg dhruv-deshmukh-496649-unsplash.jpg dmitry-sovyak-454068-unsplash.jpg dominik-dombrowski-80197-unsplash.jpg drew-farwell-481111-unsplash.jpg drew-farwell-481113-unsplash.jpg drew-farwell-481114-unsplash.jpg drew-farwell-509573-unsplash.jpg eberhard-grossgasteiger-487123-unsplash.jpg elijah-hiett-251983-unsplash.jpg Emory-River-Oakdale-tn1.jpg enelia-sandoval-23924-unsplash.jpg erwan-hesry-360406-unsplash.jpg fabian-struwe-203029-unsplash.jpg fabio-rose-262-unsplash.jpg felix-russell-saw-103677-unsplash.jpg fer-bozzoletti-373918-unsplash.jpg foad-manghouly-8794-unsplash.jpg Forest-Creek-Eagleville-PA-USA.jpg gabriel-rodriguez-516043-unsplash.jpg ganapathy-kumar-113607-unsplash.jpg gary-saldana-392773-unsplash.jpg geno-church-404472-unsplash.jpg georg-wolf-99332-unsplash.jpg geran-de-klerk-148428-unsplash.jpg gert-boers-137605-unsplash.jpg ghost-presenter-460223-unsplash.jpg harshil-gudka-455166-unsplash.jpg hatim-belyamani-43882-unsplash.jpg heather-shevlin-369400-unsplash.jpg heather-shevlin-369432-unsplash.jpg henry-be-112315-unsplash.jpg iler-stoe-330161-unsplash.jpg ivan-chen-37375-unsplash.jpg ivo-paul-van-vliet-513818-unsplash.jpg jack-robinson-123316-unsplash.jpg jake-anderson-1030-unsplash.jpg jakob-owens-300992-unsplash.jpg james-brown-417950-unsplash.jpg jason-patrick-schuller-186532-unsplash.jpg jayson-mcnasher-47099-unsplash.jpg jean-wimmerlin-535179-unsplash.jpg jeff-king-115537-unsplash.jpg jeff-lemond-401169-unsplash.jpg jens-johnsson-346359-unsplash.jpg jens-johnsson-415855-unsplash.jpg jimmy-chang-38194-unsplash.jpg jinen-shah-135167-unsplash.jpg joel-filipe-193035-unsplash.jpg joel-herzog-105060-unsplash.jpg joel-herzog-106575-unsplash.jpg johannes-plenio-265708-unsplash.jpg john-salzarulo-138022-unsplash.jpg john-salzarulo-138024-unsplash.jpg johnny-chen-77988-unsplash.jpg jon-flobrant-65429-unsplash.jpg jon-grogan-37496-unsplash.jpg jonatan-pie-189646-unsplash.jpg jonatan-pie-367734-unsplash.jpg jorge-tung-523295-unsplash.jpg joseph-barrientos-17269-unsplash.jpg josh-soriano-323532-unsplash.jpg joshua-gresham-19647-unsplash.jpg jota-lao-368605-unsplash.jpg julie-marsh-499183-unsplash.jpg justyn-warner-519466-unsplash.jpg kambani-ramano-601015-unsplash.jpg keagan-henman-388756-unsplash.jpg ken-goulding-520091-unsplash.jpg ken-treloar-468615-unsplash.jpg kevin-ngo-543177-unsplash.jpg krisztina-kovari-634554-unsplash.jpg lefty-kasdaglis-418757-unsplash.jpg levi-saunders-71728-unsplash.jpg luca-bravo-24241-unsplash.jpg luca-bravo-423222-unsplash.jpg luca-micheli-580599-unsplash.jpg

maeghan-smulders-470753-unsplash.jpg mahir-uysal-374254-unsplash.jpg mahir-uysal-374295-unsplash.jpg malte-bremer-33760-unsplash.jpg mandy-beerley-154518-unsplash.jpg mar-bocatcat-293299-unsplash.jpg marc-szeglat-556359-unsplash.jpg marc-szeglat-556377-unsplash.jpg marc-wieland-86481-unsplash.jpg marcus-lofvenberg-438000-unsplash.jpg matt-artz-353129-unsplash.jpg matt-artz-354170-unsplash.jpg matt-artz-397014-unsplash.jpg matt-gross-610573-unsplash.jpg matt-gunnar-625467-unsplash.jpg max-panama-387820-unsplash.jpg micaela-parente-607693-unsplash.jpg michael-manns-562573-unsplash.jpg michal-kmet-198065-unsplash.jpg michal-prucha-233888-unsplash.jpg miguel-oros-421476-unsplash.jpg mindi-head-56929-unsplash.jpg nathan-anderson-166684-unsplash.jpg neil-fedorowycz-469554-unsplash.jpg nguyen-tran-422751-unsplash.jpg nikita-andreev-412706-unsplash.jpg olivier-miche-87563-unsplash.jpg osman-rana-267040-unsplash.jpg ozark-drones-86373-unsplash.jpg parsing-eye-493247-unsplash.jpg pascal-habermann-393178-unsplash.jpg patrick-hendry-204722-unsplash.jpg patrick-hendry-426396-unsplash.jpg patrick-hendry-464036-unsplash.jpg patrick-hendry-624731-unsplash.jpg paul-illsley-332705-unsplash.jpg paxson-woelber-533417-unsplash.jpg peter-gonzalez-317720-unsplash.jpg peter-wimberg-514092-unsplash.jpg phillip-sauerbeck-27910-unsplash.jpg pierpaolo-lanfrancotti-185555-unsplash.jpg pierre-yves-burgi-579337-unsplash.jpg rene-bieder-100774-unsplash.jpg rich-jones-539164-unsplash.jpg rick-waalders-123-unsplash.jpg rob-bye-98951-unsplash.jpg robert-baker-534726-unsplash.jpg ryan-cheng-486086-unsplash.jpg sahar-kanyas-488917-unsplash.jpg sam-bloom-433221-unsplash.jpg samantha-scholl-157431-unsplash.jpg samuel-ferrara-136526-unsplash.jpg savs-503993-unsplash.jpg scott-webb-14008-unsplash.jpg sebastian-engler-65104-unsplash.jpg sebastian-unrau-47679-unsplash.jpg sergei-akulich-39911-unsplash.jpg sergei-akulich-39913-unsplash.jpg shaun-darwood-632440-unsplash.jpg shaun-mills-562130-unsplash.jpg shawn-appel-281454-unsplash.jpg shwetangi-gupta-445839-unsplash.jpg simon-migaj-561506-unsplash.jpg sol-mitnick-501848-unsplash.jpg steve-halama-256903-unsplash.jpg steve-halama-257726-unsplash.jpg steve-halama-275664-unsplash.jpg steve-halama-279473-unsplash.jpg steve-halama-351494-unsplash.jpg steve-halama-369630-unsplash.jpg steve-halama-370689-unsplash.jpg suganth-393816-unsplash.jpg syd-sujuaan-193320-unsplash.jpg teddy-kelley-106391-unsplash.jpg thomas-fields-459399-unsplash.jpg tianqi-zhang-339721-unsplash.jpg tim-marshall-142130-unsplash.jpg tim-martin-402257-unsplash.jpg tim-neal-375540-unsplash.jpg timothy-simon-9728-unsplash.jpg toa-heftiba-434895-unsplash.jpg tommy-tang-413982-unsplash.jpg uriel-soberanes-402024-unsplash.jpg victoria-dihua-xue-97968-unsplash.jpg vincent-guth-136868-unsplash.jpg wellington-rodrigues-575552-unsplash.jpg willian-justen-de-vasconcellos-426899-unsplash.jpg wynand-uys-543117-unsplash.jpg xus-badia-92933-unsplash.jpg yang-shuo-485056-unsplash.jpg yanguang-lan-34703-unsplash.jpg zbynek-burival-517983-unsplash.jpg


import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.effects.*;
import ddf.minim.signals.*;
import ddf.minim.spi.*;
import ddf.minim.ugens.*;

import processing.sound.*; 

Minim minim;
AudioPlayer player;

Movie m;
Movie sad;

void setup() {
 // size(640, 360);
  m = new Movie(this, "");
  minim = new Minim(this); 
  player = minim.loadFile("glitch.mp3");

void draw() {
image(m, 0, 0, width, height);


void keyPressed() {;;


  for (int y = 0; y < m.height; y += 10) {
    for (int x = 0; x < m.width; x += 10) {
      //how do we create a mirror image?
      int i = x + y * m.width;

      color c = m.pixels[i];
      float newX = map(x, 0, m.width, 0, width);
      float newY = map(y, 0, m.height, 0, height);

      rect(newX, newY, 20, 20);

      //ellipse(x, y, 20, 20);

  //image(cam, 0, 0);


// Called every time a new frame is available to read
void movieEvent(Movie m) {;


void keyReleased(){

Final Performance/Project Documentation (Sean)

Team: Findlay, Patricia and I


4 large white posterboards

Cardboard stands


Greenscreen room

Camera and audio recording supplies



Project Overview:

We wanted to show the different kinds of abuse students our age and young adults experience, types that often lack awareness and may even be covered up. As the majority of the show audience were students, we wanted to show that this types of relationships also qualify as abuse and that abuse survivors aren’t alone, that they can succeed, overcome and most importantly be heard. In order to illustrate this message, we chose 4 stories of abuse that the survivor had published online in their own words, because we wanted to use real stories that the survivors were ok with being shared. We then chose 4 actors to portray their stories on screen, projection mapping them onto 4 poster boards for the performance. The whole goal of this was playing with the idea of voice and realness, portraying these true stories with actors that appear life-sized and real, yet distant because they were projection mapped.



We started with brainstorming and research. We all had a lot of ideas, but eventually narrowed it down to the topic of abuse, which we wanted to portray in a respectful, storytelling way to raise awareness. There are so many different types of abuse that impact and affect so many young people that probably feel like they don’t have a voice or can’t talk about it, so we started by creating a giant word doc and pasting articles and research. We focused on true stories written and published by the survivors so that we could use their own words in the first person, and tried to create a diverse group that represented different instances of abuse.


Simultaneously, we started thinking about how we would portray these stories. We wanted the stage layout to be engaging and also incorporate the themes we had in mind. We had a lot of ideas initially that turned out not to be feasible, as shown by two stage mockups we had early on:


We also originally wanted to incorporate a live element into the show, such as VJing or DJing the audio somehow, but we ended going with a prepared audio and video to prevent any live hiccups.


We finally nailed down the script, and decided to use the stories of Emma Sulkowicz (survivor of college date rape), Terrence Chappell (gay domestic abuse survivor), McKayla Maroney (survivor of Larry Nassar’s abuse as the official Olympic team doctor) and an anonymous account published online from a girl abused by her uncle and a survivor of child pornography.


After we nailed down the script we moved to filming. We used the 9th floor greenscreen room to record our actors. We created a script for each person of about 3-5 minutes to use in the performance, and had the actors read the script in an authentic, respectful way, in the original words of the authors.


Next we moved to the most intimidating part, editing. We had to cut up each line and improve and even out the audio in order to tell their stories cohesively but together. We paired different lines together and created a full cut. Finally, we made the distorted cut, blurring and distorting both the people and words so that their stories were slowly revealed over the performance as the words and people became less distorted. For all the editing, we used Premiere’s video and audio effects to both clean up the footage and audio and add the distortions and After Effects to place them on the screen for projection mapping. The whole process was symbolic of them finding their voices and finally speaking their truth.

Here’s some screen grabs from when we started editing, showing how we used Premiere and After Effects to create the final result:

After that, we moved onto rehearsals. We used 3 of the original actors (one wasn’t available on the show day) to hold up the poster boards and give them life, as the actors were partially visible behind them and carrying them onto the stage. The actors carried them to marked spots on the stage, which were already lined up with the projector.



Overall, I thought it went very well, as it accomplished our goal of telling their stories and raising awareness in an artful way by bringing their stories to life. While during the actual performance due to technical issues the sound was a bit low, the rest of it went according to plan with us finding our places with the poster boards and holding them.


We received a lot of great feedback on everything from our content and actors to our presentation and format, and while there are a lot of things we could have done differently, during the process we discussed every detail and decision so I feel good about the ones we made in the end.

Une Pipe: Hyperbolic Electronic Orchestra Final

Like much of the work that I’ve produced over the last year, Une Pipe explored themes related to Baudrilliard’s conception of hyper-reality, as well as the well known Marshall McLuhan mantra of “the medium [being] the message.” However, while many other works that I’ve created have tackled this mostly in form, my Hyperbolic Electronic Orchestra piece also attempted to tackle these topics in content as well.
Structurally, the piece is relatively simple, with the contents on screen slowly “evolving” from pre-human origins, to video recordings of nature, until eventually the audience watches as the development of human civilization is complicated by the creation of various technological media. Each “section” addresses a step in Baudrillard’s theories on Simulation and Simulacra which state that as technology becomes increasingly advanced, eventually we will not only no longer be able to distinguish simulation from “base reality” but simulation will have an impact on our “real” world much as our “real” world once dictated the laws of simulation.
However, wanting to avoid positing that the reality we exist in is the original realm, I decided to begin the piece with computer generated images and simulations of the big bang and a DMT trip (in order to visualize connecting with a higher being or the catalyst of human consciousness). From there the piece delves into the realm of nature shots, all recorded using cameras to “capture” the “real” world, before the form of the footage begins to glitch out with the introduction of the television static and advertisements as a visual motif. Finally, once the computer screen begins to load up, advertisements and videos involving “deep fakes” (in which AI powered programs digitally face swap people’s faces onto other’s bodies) try to force users to confront the fact that we now live in a world in which “cat fishing,” “deep fakes,” and “fake news” (arguably all a product of what is traditionally considered the simulation) have impacted and altered our reality. Connecting this section to the one prior are clips of reality television shows that attempt to highlight how television and media in general has helped to blur this distinction between “true” and “false.”
The audio for the first two sections (Twin Peaks Theme) was chosen because of it’s origins as a theme song for an incredibly surreal show. I like to imagine what aliens would think of our world if this were the only media they were to encounter about our planet, as it is sometimes simply a drama about life in a small town, while other times becoming a super natural crime thriller. The second audio is a remix of the first song, meant to emphasize the way in which technological advancement has allowed us to “remix” our own realities.
I worked alone; however, I do believe I could have benefited from working with a partner. My original goal for the piece was to combine two patches that I’d created previously to mix an element of my own orchestration with random chance (allowing clips to be chosen from a bank of samples, though on my own queuing), but the merging of patches eventually fell to the wayside as I attempted to perfect my video piece’s artistic vision.
While my piece specifically addressed the concept of hyperreality in content, I was (happily) surprised by the number of pieces that incorporated glitching and other digital art techniques because it made me feel as if I was tapping into a particular vein of this artistic moment. And while my individual piece experienced some technical problems, I was actually quite happy with those issues as they helped me even further blur the line between what was “real” about performance versus what was spontaneous.
Here are the clips used as well as the final video:



Welcome one and all! We here at Bubble Corporation are excited to introduce to you a new social media experience, unlike anything you have seen before!

The following is an outline of the project that Amy, Justin and I set out to create:

A live social media experience wherein the audience becomes an active participant of our social media orchestral score.

In order to conduct a performance of Bubbles: The Live Social Experiment one must be able to create and construct their own version of the Bubbles website. Then they must construct an applet for audience members to use. They must have a convincing host and they must have an audience.

For our interpretation of the above ruleset Amy, Justin and I created this:

and this as our applet:

Amy and I played the convincing hosts:

And we had an audience:

Initially our project looked nothing like this, we tossed around ideas like, “what if we just walked on stage, set our computer down and then walked off”, “shafts of light come from the ceiling illuminating different parts of the stage”

But Amy brought up a piece that she saw earlier in her Video Art class where the artist asked audience members to group up and play a video associated with their group. The artist would then collect their phones, creating a cacophony of sound. He would then take the collection bin and shove it off to the side and say “now I have your attention”. And this idea grabbed us, audience participation felt like it could be very important. When I initially grouped up, one of the instruments I created in class was designed a randomized ruleset. What I thought would be cool is if the audience was participating as our performers instead of us, but while this initial idea didn’t make it into our final project fragments of it shows up in our work. So we came up with the idea of a live social media experience–one where the user wasn’t confined to their own privacy, they would have to have an opinion and be able to publicize it in the audience. Here’s a rough amalgamation from the first iteration:

In order to separate an audience participant from those around them we decided to use sound and color, each emoji would be associated with a sound and a color, so if a picture of trump showed up–you and your friend vote and one of you might have a laugh sfx and a blue light, and you look over and your friend has a boo sfx and a red light.

The main interest was taking the conversations we were having on the web and bring them back to the real world, whether that succeeded or not remains to be seen….

In order to have something for our audiences to interact with I helped design the social media interface for our ‘website’ Instead of coming up with a complicated way to show media, we just used video where images cycled every 15 seconds for users to interact with. Here’s an example of it:

We wanted to tackle a lot of things with this project like what happens when your opinion is public, the publicity of our personal data and what happens when it is abused. What we initially intended that never made it into the final project was a screen that would act as a poll screen that would poll answers from the crowd, but instead of offering an actual estimate–it would display game-ified statistics to instill a distrust in the crowd. (I wish we ended up doing this)

I wish that we had more time to design the interface and to add more animations to the project, I wish there was more of a direction to the images we chose to show, I just wish more could have been done, but we’re a small team and that’s always possible with a future performance.

Performance-wise on the night I was just glad that people seemed engaged with what we were trying to do. In an earlier test in class many of the people didn’t participate so this was just a happy surprise to see people’s phones light up in the crowd. There definitely could have been some better coordination between us and the lighting tech, a few last minute hiccups before the performance changed some things that were supposed to happen, but I felt that all in all it went better than expected. I would love to have a chance to perform this piece again.

Because this class didn’t have a necessary course set at the start it was incredibly interesting to see what came out of the weeks preparing for the show, people went in all sorts of directions with their projects and it was very interesting to see the outcome. One piece in particular that stood out, or maybe it’s just the sound of it that echoes in my ears was the third piece *update this*. The odyssey of a character spilling coffee and the remarkably catchy and ethereal track that accompanied it really sticks in my mind even after the show ended.

Final Documentation for Hyperbolic Orchestra

It was a super awesome performance at Power Station of Art! I really loved all performance led by my classmates which gave me many new ideas and concpets of “orchestra”. And also many thanks to professor Clute and professor Chen who decided to mix these two classes and we had an opportunity to combine audio and video arts together to generate these amazing outcomes.

I collaborated with Shiny Wu and Cindy Yudi Jia from Video Art class working on our project Distorted. Distorted is an audiovisual performance showing distorted personalities through a combination of videos and sounds in an installation form. 

Same person with different personalities is a common scene in daily lives. Even with people who have no dissociative identity disorder, they may behave differently in different situations when facing different people/occasions, which we called as “impression management.” We want to show that sometimes these “managements” can be effective for good, and eventually becomes uncontrollable.

To achieve this, our plan for this performance was to:

  • have a performer moving the mirror frames which stand at the center of the stage
    1. the turning of the mirror frames represent the fluidity and unpredictability of constantly changing personalities;
    2. by pushing the frames to turn and crossing them, the performer will exhibit that it is not at his/her will to control the speed and the changing of personalities
  • videos will projected on the big screen
    1. the distortion between the performer(real-time reality) and the distorted images on the big screen showing different personalities
  • some other visual effects will be projected on frames (due to stage limit and considering the integrity of performance, this idea was dropped)
  • audio will be processed with sound effects like delay and reverb
  • videos, visuasl effects and audios will change along to the performer’s movement

Having made plan, we started to build up project. We built installation and developed content at the same time. We spent a lot of time discussing the structure and we tried many times constructing and we failed many times because of material choice and budget-limit.

this is our initial idea of structure

Then at last, we thought of Ann’s suggestion of umbrella structure and found it would work better than others. So we built a base using spinning plate and PVC pipes so the whole structure could spin. And for the head part, we used cardboard, wood board, shiny paper and fabric to built frames, or let’s say, curtains, which served the same purpose.


This was what the installation look like finally. And it was super fragile so we thought about many ways to transport and store it safely and we decided to assemble it at PSA and just leave it there.

And about the content, we filmed video footage and found many footage online and put them together in different layers in grids to indicate different personalities. It showed how the protagonist went through several status of white-collar, scared girl, desperate woman, stubborn old man and helpless dog.

For the audio, I used Max/MSP to build a player that could play bunch of audio files at the same time and change the speed and even reverse it. I got 12 different sound pieces and many of them were created/recorded in Logic Pro by ourselves. Also, to make the sound fit into the context, I also mixed it with delay and reverbs. These sound, generally are theme songs for each personality and transition, so audience will easily notice there’s a transition between personalities and what specific personality it is by perceiving different audios and video clips and movements performance with installation.

To be honest, I was really impressed by all the performance at PSA and they were totally distinctive. I was rarely into video art and never realized video cotent could be rearranged to illustrate a completely different experience. And I think it was really cool to let live performer and pre-recorded video content get involved with each other because one is in 2 dimension and the other is in 3 dimension, and not to metion the intensive interactions and subtle connections between them. The light was also a very interesting factor. When Demi’s group was performing, I was absolutely attracted by their video content and the live light. Angle was processing audio when the highlight was her and it perfectly strengthen the connection between her and the video content.

Was there any unexpected problem during the performance? Yes there are! The one happened to our group was the light. Since we didn’t have a mark on the floor so we didn’t realize the installation would not be under the highlight, so when the light was on, I had to move the installtion to the center of the light and tried to let it be part of my perforance to not let audience notice that was an accident. Then there was also an accident of the timing for light. The light was on much earlier than when it was supposed to be on, and fortunately, we made some slight modifications to the performance immediately on video and audio and also my movements, and it seemed more natural than I thought so it was just fine 哈哈.

So here is the video on vimeo that shows our performance at Power Station of Art Museum in Shanghai at May 6 and please feel free to let us know what you think.

(Contents above partially credit to my collaborators Shiny Wu and Cindy Yudi Jia.)


Hyperbolic Electronic Orchestra Final Documentation

Our project, entitled ‘Bubbles’ is a parody format social media platform that plays on the not-so-private practices of social media services today. Almost every Facebook user has come across a time when they notice advertisements popping up which were very accurately tailored to their recent search engine habits.

‘Bubbles’ utilities careful visual curation as well as sound design to create a compelling, interactive experience with the audience. At the trial stage of the app, we go through user controls step by step and allow the audience to demo the app in real time. We have used colors and sounds coming from the phones, to add to the visual experience for the audience.

Our project was heavily based on collaboration. After countless brainstorming sessions and picking each others’ brains, we came to the genius conclusion that ‘Bubbles’ would indeed be our contribution to the piece. The score we integrated was meant to be user- initiative so as to give the crowd full creative freedom and see where they decide to take it.

Creatively, I contributed primarily to the visuals & sound fx curation, as well as the curation of the speeches our team gave. My group members and I came together to gather random visuals, and later on narrowed things down to just a few key visuals that come together to tell a funny narrative. We decided to do a keynote style presentation, reminiscent of Steve Jobs or Tim Cook, and thus created this script:

[Hey Everyone] We are so happy to have you all here today! [Ad-lib if you catch people on their cellphones in the crowd] We are living, now more than ever, in an interconnected world. And in a crowded sphere full of social media apps, it’s time now for a breath of fresh air.

[Introduce the Product] Introducing bubbles. The only social media service you will ever need. Make friends, chat with them and share photos, video and other content. It’s all there and more.

[to Amy] Hey Amy, can you get out here for a second. Hey everyone, lets give a round of applause to our CTO Amy DeCillis! [Applause]

[Amy] Hello guys! We’re so happy that you could make it here today! We’d like to give you a taste of what’s to come with the release of bubbles 1.0! Here’s a look at our standard homepage. As you can see we have all the basic functionality of your favorite social media services. Here is our news feed.

Here’s how it works! [Amy Demos] Now it’s YOUR turn! Everybody take out your cellphones and scan the QR code on the screen to start using our new app! Also, because of this special occasion, at the end we will be giving one lucky winner 500rmb, so make sure you’re participating!

[cut lights and have audience interact with website]

[bring back the spotlight on Justin]

[Announce Winner] Attention everyone! We have our winner…Lillian Korinek! We felt like you would be a great recipient of this money. You seem innocent enough since you loved the images of horse and the beach, funny enough since you liked the memes, and smart enough since you hated the images of Donald Trump. We also noticed that you’ve recently been buying a lot of toys for your cat on taobao, so you must be a kind animal lover. But you’re not just an animal lover, no, we can see that you also have been calling your mother every day for the last month. Please let her know we hope she can beat this cancer soon.

[Lillian looking appalled the entire time] What??

Cut lights


  • scan QR code
  • one of you will go home with 500rmb

Sound Fx Files :


Thoughts on Final Concert

Although I didn’t attend the final concert, I spent quite a bit of time reviewing the footage and assessing our progress. I believe that ‘Bubble’s’ was an excellent turnout. Joel started off the presentation on a very enthusiastic note and maintained the energy throughout. It seemed as though people were very receptive to both our concept, particularly the visual aspects. The fact that our visual curation of the colors and sound, worked out quite seamlessly.  What better way to engage people than to let them wander on their phones?

I was disappointed not being able to make the rehearsal, and ultimately being told not to come for the performance. However, I deeply thank my group members for holding things together despite my absence. Joel did an excellent time editing together the visuals and  sound fxalso creating the light sources. Amy did an amazing time with the video content, editing it together beautifully so that it fits right in the center of the page.

Write an explanation of your project, score, performance, etc.
Describe how you contributed to the collaborative process (if collaborative)
Write a reflection on the final concert (both your work and the work of others)
Upload any video documentation you might have (the process not the final concert)
Upload any scores, schematics, patches, apps, etc. as jpgs or text that you created for the project


In-Class Score Documentation



De’yon Smith and Lillian; Final Documentation (Clute) EHO

A Niente

I really enjoyed working on this final project, I had the amazing opportunity to work with Lilian who is a senior and has multiple years of experience in creating a creative project. When given the idea of creating a piece that would be used in a hyperbolic orchestra concert I was very curious and was fueled by many ideas. Lillian and I decided that we wanted to focus on a serious topic that introduces the effects of human on the environment. We wanted our project to be entertaining but also informative. Lillian has excellent coding skill and I have a background in dance so we wanted to combine these skills that would be from a collaboration between a physical and visual experience. We both put a lot of time and energy into creating this project since it contains so many different features to it. We worked really well with one another and were able to get to a common ground for every decision that we made. Lillian and I spoke to each other about what roles we would take on in the performance, and we liked the idea of Lilian being the “human” and I would be “father nature.” After creating the full performance I shorted my name to be just “nature” so that it could be easily said and heard when promoting the roles of our characters. Nature and Human would battle the plant (the earth).

When started to choreograph and design the video we had these questions that we hoped would be answered and explained throughout the performance.

Are we interested in man’s relationship with nature, and the line humanity draws between itself and the Earth? At what point do we consider nature something separate from ourselves? Humanity has had impacted the environment. We continue to pollute and abuse the Earth’s resources despite the fact we are completely reliant on it and part of it. Is there a ‘glitch’ in humanity’s code that allows us to forget our intrinsic ties to the Earth?”

We first started working on the music for our video, we contact Julia who agreed to be our “Dj” at the time which meant she would help us mix the music. We had to find background noises (such as the animals and nature like sounds) as well as the main theme song. We first mixed the battle music. The first part of the music contained a creepy melody that creates this suspicion and uncertainty.

It starts out with the introduction melody which creates this state of confusion between the two characters of who each is and what they’re doing. The plant is caught in between these two characters. It is at that time that two individuals recognize each other and, father nature notices the “humans” mischievous looks at the plant. They start getting close acting friendly but then starts becoming more aggressive because of how the situation escalated.

The Humans characteristic are more childlike and oblivious to the dangerous actions she is taking and how detrimental it could be. On the other hand, nature is more level headed and trying to warn her and stop her drastic efforts. Towards the end, the two battle for the plant and the plant is then launched into the area and is scattered everywhere and there is no possible way of recovering the remains.  Nature is so shocked and hurt by the destruction of destructuring of the plant that he can not bear to live or survive without it. In the end, nature dies and humans are still oblivious to her decisions. The end is supposed to symbolize the destruction of human interaction with the environment and how poor decisions affects the Plant (earth) could be the elimination of nature.

The video that is being played on the screen in the back first starts off displaying beautiful scenery and healthy luscious green land. After there is a massive glitch in the music the screen images start to glitch and it starts to shift towards more natural disasters and human-inflicted damages to the environment. During these images, the video is being glitchy because it shows how it malfunctions and how the planet itself malfunctions. The video goes until it turns blacks at that time the plant itself is broken and scattered everywhere.

I think the costumes that we wore really represented the roles that were taking on. Lillian had the brilliant idea of wearing a suit which would represent a standard businessman. I wore a pink skirt (blanket) that had flowers on it as well as tree branches and a flowered scepter which represented a father nature like figure who was in charge of protecting and collaborating with the planet in peace and harmony.

To add to that, I personally believe that the concert was a great performance and an accurate representation of everyone’s themes and idea that they were trying to express. I think that our IMA show was an actual performance that required a dress rehearsal and a lot of time and precision. Everyone was dedicated to their own piece. Having the privilege of actually being in the class and seeing the growth of everyone’s project was amazing. This was a fantastic class in which I learned so much about collaborating on creative pieces. I learned there’s always room to express more creativity or to look at something through a different lens. As for our own performance we had to change the perimeter of our performance and our choreography in order to fit the stage more accurately. I was in constant contact with the person in control of the lighting because we wanted our performance to be impressional and shown to the best of its ability. It was hard work but the crowds, peers, and professors expressions and applauds were worth the reward!

Music  link :

Score and Set Up


Video: Glitch (3:40)


Questions: How short should the video be? Where are there prominent repeats in the video? Do we like the beginning and ending?


Before Tomorrow (05/03/2018):

  • fullScreen needs to be fixed in Processing
  • Video without sound needs to be prepared


Items Needed:

  • DJ Table
  • Plant (to be transported Sunday)
  • 2 Stools (relatively the same size)


Video: Julia (controller of glitching)



Lighting Plot:

Scene Time Lighting Sound Video
Peaceful Entrance 0:00 – 0:15 Yellow Light Entrance music Blank
Confusion Sequence 0:15-0:50 Green Light Child like creepy music Healthy Environment
Glitch 0:50-1:00 Flickering Light Static Glitchy
Random Sequence 1:00-2:45

25 seconds

Red Light Battle music Glitchy
Spot Light Sequence 2:45-3:30 Green Light/White Battle music Glichy
Last Choreography/Close 3:30/3:40 Light dimmers to nothing Winding Down/Drastic End music Black


Final Project: “Anxiety” with Demi, Grace and Leah

As for the final project in the Hyperbolic electronic orchestra class, Demi and I collaborated with two other students in video art class to create the final show. We have communicated a lot on the choice of the theme and how we approach it. Initially, we want to focus on the four elements in nature as “water, fire, sand, and wood”, however, it’s really hard to find the interconnection among different element and its meaning to explore these four elements at the present times. Later on, we choose to change our direction towards a universal phenomenon — “Anxiety”. Not only do we have the concern on our study and life, nearly everyone in this society have some worries or struggles gnawing them. We hope to use our project to reflect “anxiety” around us. There is no specific “he or she” in this video, which means it can be anyone that has the resonance with us.

As soon as we settled down our theme, we divided our work into two parts. Demi and I mainly target the audio; While grace and Leah are responsible for the video.  Here, I will briefly introduce the score in our audio project. As first, we divided the audio output into three layers: POV (recorded from the original video; background music (created before the show); live performance (triggered by different sensors). I’m mainly responsible for the third part and I have negotiated with them on how to convey our ideas through different sensors. The first choice coming up to my mind is to use the temperature sensor since the rise of the temperature can represent the change of our feeling. The more anxious we are, the higher the temperature is. Therefore, I edited three pieces of music which highly matched our video and theme and coded them in MAX to separate them into three temperature range. (The most accurate temperature range is decided before the show time since the temperature in music hall might to slightly different from our school). I have attached the code from MAX as below, which includes two tracks: one track for the temperature sensor; one track for the touch sensor. The three pieces of music actually corresponding to three scenes in the video: body weight; wearing earrings and constantly running the stairs in 11F. The main character or we can treat her as one of “us” commonly experience these circumstances in our daily life. The whole atmosphere in this video has been increased step by step, just as the temperature goes.

Secondly, we chose to add the touch sensor to our project since we hope to create the “live special sound effects” in our final show. Whenever the “spider web” appears in the video, I will control the touch sensor to trigger the “Si Si..” data transmission sound, which will greatly enrich audience’s audio-visual experience and also increase the sense of suspense in our project. Here are some screenshots from the video that are arranged for the “special effect” as the live performance. The vivid “spider web” also mimics the struggles in our deep heart that cannot be easily exposed to others.

Finally, as for the final concert, I deeply enjoyed it and want to initially express my sincere thanks to professor Ann Chen, Sean Clute, and Antonius. It’s really helpful for us to have two rounds rehearsal before the final show and get their suggestions on our final projects. At first, we think it might be cool to arrange the table on the right side of the music hall so that both Demi and I can control our “instrument” and make it visible to audiences. However, we found that it seems impossible to separate a free table on that day and we finally decided to only show up my live performance in that corner. At that moment, I also have fear in my heart, but I believe that my practice will not fail me. It finally turns out to be successful and I’m also proud that I overcome the “Anxiety”. I really enjoyed the live way to make the performance and I think the previous experience in NIME also help me to get the better of my fear in front of the audiences. In the end, I think we can still explore more in regard to “anxiety” from different occupations, different ages, and different personalities. This project has the great potentiality to be expanded to a more realistic project which comes from our daily life but higher than the life. Speical thanks to all of the staffs, professors and my best teammates!


#include <OneWire.h>

int DS18S20_Pin = 3; //DS18S20 Signal pin on digital 2

//Touch Sensors
const int TouchPin1 = 2;
boolean oldTouchState1 = LOW;
boolean newTouchState1 = LOW;
boolean LedStatus1 = LOW;
int TouchOutput1;

//Temperature chip i/o
OneWire ds(DS18S20_Pin);  // on digital pin 2

void setup(void) {
  pinMode(TouchPin1, INPUT);

void loop(void) {
  // Touch Sensors
  newTouchState1 = digitalRead(TouchPin1);
  if ( newTouchState1 != oldTouchState1 ) {
    if ( newTouchState1 == HIGH ) {
      if ( LedStatus1 == LOW ) {
        TouchOutput1 = 1; LedStatus1 = HIGH;
      else {
        TouchOutput1 = 0;
        LedStatus1 = LOW;
    oldTouchState1 = newTouchState1;

  float temperature = getTemp();
  Serial.print(" ");

  delay(100); //just here to slow down the output so it is easier to read


float getTemp() {
  //returns the temperature from one DS18S20 in DEG Celsius

  byte data[12];
  byte addr[8];

  if ( ! {
    //no more sensors on chain, reset search
    return -1000;

  if ( OneWire::crc8( addr, 7) != addr[7]) {
    Serial.println("CRC is not valid!");
    return -1000;

  if ( addr[0] != 0x10 && addr[0] != 0x28) {
    Serial.print("Device is not recognized");
    return -1000;

  ds.write(0x44, 1); // start conversion, with parasite power on at the end

  byte present = ds.reset();;
  ds.write(0xBE); // Read Scratchpad

  for (int i = 0; i < 9; i++) { // we need 9 bytes
    data[i] =;


  byte MSB = data[1];
  byte LSB = data[0];

  float tempRead = ((MSB << 8) | LSB); //using two's compliment
  float TemperatureSum = tempRead / 16;

  return TemperatureSum;


Final Hyperbolic Class Proposal

Short Description of the work:

Try to show how elements build up the whole world and also the modern understanding of the traditional elements.

A draft of your score:

Demi and Angel each will be mainly responsible for two instruments. Whenever the previous element in the video changes or transforms to the other element, we will change our instrument to trigger different music piece for that element. There also might be the live show in the performance if possible.

How many instruments will there be?

Two to three (include the computer). We probably will use MIDI keyboard to play the background music and use “ice and water” combining with the temperature sensor to trigger the music for “water element”. In addition, we prepare to use the computer to play the other two music for different elements.

What kind of instruments are required?

Most of the work will be done within Maxmsp, we will create synthesis sound and uses styles like drone music and repetitive structure. We will control the music with external sensors as well, such as temperature sensor, touch sensor etc.

Who is in your core group?

Demi and angle will collaborate with two other students from Video Art class.