Week 4: Research Project(Rudi)

My definition of interaction is that interaction is a process of input, reaction, then output. It is based on various technology programming thus can be presented in different ways. It can be regarded as a way of communication in a degree. The process of interaction involves that someone states an instruction, then one in the middle gathers and deals with the information, and finally being put out by the third.

 

The first project which I enjoy is “Penguins Mirror”. “Penguins Mirror” is an installation scattered on the floor and comprised of 450 motorized stuffed animals. It performs an absurdly homogeneous system of movement. Playing with the compositional possibilities of black and white, each penguin turns from side to side and responds to the presence of an audience. As they perform, the penguins’ collective intelligence is puzzling, yet somehow familiar, as the plush toys enact a precise choreography rooted in geometry (Rozin, Daniel. “Penguins Mirror.” https://vimeo.com/129674054). One of the reasons why I like “Penguins Mirror” is that the contrast of black and white is quite obvious, so that I could clearly identify the sculpt which the audience is trying to present. Secondly, the movement of the penguins is extremely cute and picturesque. That’s to say, the pose of the audience is enlarged by the movement of the penguins and becomes vivid during the process. I consider this interactive project useful and contains the theory of art. Therefore, I find “Penguins Mirror” interesting.

On the contrary, the second project which I do not like is “The chAIr Project”. “The chAIr Project” is a series of four chairs created using a generative neural network (GAN) trained on a dataset of iconic 20th-century chairs with the goal to “generate a classic” (Visnjic, Filip. “The chAIr Project – Reversing the role of human and machine in the design process.” https://www.creativeapplications.net/objects/the-chair-project-reversing-the-roles-of-human-and-machine-in-the-design-process/). The main reason that I dislike the project is that it is not useful at all. In my mind, the function of chairs is to provide a seat for people, more specifically, a comfortable seat. But some of the chairs in “The chAIr Project” are lacking a seat or missing a leg. It contradicts the general aim of using a chair. Besides, I do not appreciate the style of “The chAIr Project”. Chairs in “The chAIr Project” seem quite weird that they are better to attend an art exhibition instead of designed for daily goods. Hence, I certainly don’t like “The chAIr Project”.

 

Research Project: SmartLens
Group members: Aren Chen, Iris Qin, Luna Wang, Leslie Huang.

The interactive device we designed is named SmartLens. SmartLens is designed as a pair of lens which has advanced technology in it. The functions of SmartLens include GPS, adjusting the degree of glasses, searching for information, controlling furniture and health test.

In the first place, SmartLens sufficiently presents the method of interaction. While the user is speaking or giving instructions, which is considered as input, SmartLens is able to conduct the information and react. Then, SmartLens gives output according to the instructions, such as pointing directions, providing useful information, turning the lights on or forming a health report.

Secondly, SmartLens is absolutely convenient and useful. It is portable and easy to use. Simply by putting on the lens, all the functions are ready! SmartLens can help in any place at any time. Also, it involves functions in different fields, ranging from controlling furniture as daily use to medical diagnose as academic help.

 

 

Script:

SCENE ONE

Aren: My name is Aren. Since the first day of my birth, I have my smartlens with me throughout my life.

Person A (as nurse) (running onto the stage with the baby): We have a newborn! (filling the file using voice control) Born time is 11:30 a.m. 28th September 2118. I am giving the SmartLens 15534.(while talking, “install” the device into the baby’s eye.

Robot: Identity activated, citizen Aren is registered with SmartLens 15534.

Narrator: Since SmartLens obtained certification from the state’s government, more and more people choose to place the multi-functional glasses in their children’s eyes at birth. Let’s see how the lens actually works for Aren.

SCENE TWO
Narrator: A few years passed, Aren is now a four-year-old boy. One day he is in kindergarten…

Aren: waaaaaoooo! A butterfly~~~~ . 55555555, where is here? I can’t find my way back.

Robot: Problem detected. Someone is lost. Someone is lost. Approval received. Automatic navigation launched. Please find your way home via the electronic map.

Aren: Oh my my! This is my way home! How could my eyes know! That’s so cooool! Aren running with the directions) Mom, I am back!

Robot: Problem resolved. Wish you a nice day.

SCENE THREE

Narrator: Now Aren is 18 years old. He is preparing for his SAT to get into his dream school. Unfortunately, he becomes nearsighted due to long-time staring at computer screen.

Aren (reading and writing on a book): I feel tired. OMG My vision is blurred. How can it be?! I still have tons of exercises to do.

NPC: You should get some rest. Don’t be too hard to yourself.

Aren: Nonononono. My smartlens will help me adjust my vision.

Robot: Problem detected. Someone’s got a blurred vision. 2 diopters and axis 180 for both left and right eyes. Approval received. Ready to adjust vision. Awaiting response….

Aren: Yes plz! My super smart Lens!

Robot: Response received. Processing…Done.

Aren: Yes! Got it. Thanks bro. You are always my faithful companion.

Robot: You’re welcome.

NPC: You’re solving problems faster than ever!

Aren: hmm-hmm♪ Cuz I have also opened the AC and the music player has been switched to my favourite radio channel. These are all done by my Smartlens.

NPC: OMG that’s so cool I should have them in the first place.

SCENE FOUR

Narrator: You know what, Aren has successfully entered medical school to become a future surgeon. He is now in his last year of college, and he wants to get dinner after school.

Aren (striding in the room): Ahhh, what a long day of work. I gotta have a good dinner to reward myself. Wait (staring aside), what kind of restaurant is this?

Robot: Problem detected. Need information of store located at 31.225N 121.534E. The introduction and ratings are displayed.

Person A (holding the cardboard that has info on it)

Aren (surprised): Wow! It’s a Korean, Mexican, and South African fusion food restaurant! Ratings are among top 10 in the city. I’ll try it. (going in)

Aren : That was nice! (walking toward person A as the cashier) Hello, I would like to pay for my meal.

Robot: Payment success.

SCENE FIVE

Narrator: After working relentlessly for more than ten years, Aren has become an experienced surgeon. His smartlens also helped him a lot during surgeries.

Aren (seeing a patient hhhhh): Hmm, let me see. Diagnosis program please.

Robot : Diagnosis program initiated. Scanning for infections. Complete. Scanning for broken bones. Complete. Scanning for tumors. Warning! Warning! Warning! Tumor found in patient 1118 ‘s brain! Tumor found in patient 1118 ‘s brain! Suggestion: immediate surgery! Suggestion: immediate surgery!

Narrator: Very soon…

Aren: Alright, let me see which is the best way to cut this (advertiser friendly phrase) off!
Robot: Please cut off connection one showed on your vision, then follow step two to slowly take out the tumor, and then cut off connection two. Please be aware of the superficial middle cerebral veins.

Aren: Done! This piece of technology, I mean, my body, is so useful!

This is how future interactive devices assist people in study, work and daily life. This is the end of our performance. THANK YOU!!!

 

Design process:

Performance:

There’s no doubt that life in 2118 must be more advanced. And I believe that the interactive device SmartLens which our group imagined can move the development further.

Week 4- Research Project(group)–Tianyu Zhang(Young)

Objective:

Define interaction. Analyze two interactive projects, one that you like and one that you dislike. Design an interactive device, based on your definition of interaction, to be used in the year 2118. Prototype it without the use of electronics. Indicate how this proposal derives from your critique of the established form of interaction.

 

My own definition of interaction:

The past reading mentions that Interactive devices receive input from the user, process the associated data, and produce a corresponding output.

In my opinion, interaction includes two parts: interactive and action. Interactive means that interaction at least must have two participants, one to emit signal while one to receive and react to the signal. What’s more, the one who sends the signal can get the feedback and adjust the information it sends.

And action means the input and output should be presented in some certain way, no matter the online or underline.

An interactive project that I like:

https://www.creativeapplications.net/news/deguster-laugmente-adding-new-dimensions-to-food/

Déguster l’augmenté- Adding new dimensions to food is my favorite project.

The idea of the combination of food and robot is creative and innovative. Because in the traditional way of thinking, we would consider food is to eat while the product like the robot should be made of iron.

Another reason is that nowadays, what we lack is not the advanced technology, but the sense of art in products. The desserts in this project are both eyeable and delectable.

The way the music record runs, the movement of the robot indicates the interaction inside this project as well.

These are the reasons why I like Déguster l’augmenté- Adding new dimensions to food the most.

 

An interactive project that I dislike:

https://www.creativeapplications.net/news/open-data-cam/

“Open Data Cam” is a project to help quantify the world. The example shown on the website is called” smart traffic cam”, however, there is no need for the drivers to know how many cars are participating in the traffic themselves, because GPS nowadays is advanced enough to tell us how the traffic condition is, and if there is a traffic jam, there would be a radio and phone app to tell us in time. Besides, the cost of $500 cannot be afforded by all the people. What’s more, the appearance of the product has no sense of beauty. And this kind of camera may raise the problem of personal privacy.

 

The interactive design our group designed:

Team members: Tina Zhang, Frank Wang, Coco Xu, Veronica Hu, and Alexis Li.

Name: Memory Forest

The proposal is derived from sacred Tree of Souls in Avatar which can store creature’s memory and souls.

Combined with the desire of human wanting to learn more knowledge quickly, we develop the idea of our memory tree. And because it is a product, we make it into a forest to show the quantity. 2118 must be an age of high-technology and data, all kinds of things can be transformed into data and be stored. Besides, with the development of the technology, people gradually lose their emotion, that’s why we put the download of emotion into the function of this product as well. The memory forest uses a pipe to make the connection between the user and the body of the forest.

The process of uploading and downloading shows the interaction between the user and our product.

At the end of our presentation, we strengthen the importance of control our desire of getting more powerful through advanced technology. The technology itself is a double-edged sword, we should be careful when we use it.

Function:

  1. Upload and download knowledge and memory online.
  2. Upload and download emotions

 

To show how does this memory forest works, our group created three different scenes. The first one is about knowledge, the second is about memory and the third one is about the bad effect of overusing advanced technology.

scenario:

Character

Journalist: Alexis

AI: Tina

Customer 1: Veronica

Customer 2: Coco

Customer 3: Frank

J: Good afternoon ladies and gentlemen. Today, September 24, 2118, we are proud to introduce you to a product from NYUSH: Memory Forest. This is a new type of interaction that can share everything in the universe, and it will redefine social media. Let go and have a look.

[ C1, C2, C3 on

Scene 1:

J: Hello guys! Do you want to experience the Memory Forest?

C1: No, I am so confused about my GPS reading, the deadline two hours later! I have no time to waste on this silly tree!

J: Exactly, this device can download any person’s memory and thinking into your brain, making it easy to acquire and learn all the knowledge.

C1: Really? I will try it!

AI:Uploading your trouble.

Uploading succeed.

Matching suitable memory for you.

Downloading Prof. Corpis’s memory for you.

Downloading succeed!

C1: <ideas of the Social Contract> Ohh I get it! I have tons of ideas to write my essay now!

Scene 2:

C2: Wow awesome. What else can this memory forest do?

J:Apart from getting memories and thought, you can also tell it your desire and even emotions. Why not try it yourself? Do you have anything you lost but is extremely meaningful for you?

C2: Ohhh! I had a really cute toy unicorn, accompanying me for nearly ten years. But I lost it when I was traveling in Pandora. Wait, how can you find exactly what I want??

AI:Don’t worry. Your memory is uploading. Upload succeed! (Ding!)  Your unicorn is waiting for 3D print. (someone brings the unicorn to the stage) Here is your bear!

C2: That’s my unicorn! I have never found one so similar to my original one! This memory forest is such a magic! Frank, do you wanna try it?

Scene 3:

C3: YES!! I want this, I want that, I want everything! Quick, give me what I want!

AI:downloading

Warning! Warning! Information overflow! Human body can not receive all the information!

C3: DIE

AI:Advanced technologies are double-edged swords, they can help us while they can hurt us. How they work all depends on the way we use. Once your desire surpasses your virtue, you’ll lose control and be hurt by these techniques. So be aware of what you can do and what you can’t.

 

The process of making this project:

 

Materials:

Tubes—supporter

Paperboard—top of the memory tree

Cystosepiment and paper tape—connection

Simulation leaves, wires and emoji pillow—decoration

Problem:

We do not know how to connect the tubes with the boards.

 

Solution:

After learning the features of hot melt adhesive, foam glue, and paper tape, we chose to use hot melt adhesive because it is the stickiest one.

 

Poster:

Documentation for Research Project by Yayuan Zheng, Professor Marcela

Definition of “Interaction”

For me, my definition of interaction is each other. No matter on class or doing research, or completing our own project, one of the most important things we have to consider is the action and reaction, which comes from the other side. But since it is “interact”, for both sides they need reactions. Therefore, those reactions which play significant roles need each other a lot. In the process of interaction, both sides are as “input” and “output”. Without each other, interaction would be action. The two parts, “each other” is the core of interaction. Interaction is the communication, action and reaction between each other.

Two Projects

Like

The project I like is the Bathtub-TouchScreen Display (https://creators.vice.com/en_us/article/78ezwz/aquatop-turns-your-bathtub-into-a-touchscreen-display). Why I like it is because it is so creative and practical. Most people have experienced the situation when you have an electronic device in your hand when you are taking a bath, and all the time you are worrying that it will fall into the water—sometimes it does fall. Moreover, the effect and the looking of it are so attractive. With this device, you can easily interact with your electronic device in water—in a way it even can be seen that you are interacting with the water, which is really an amazing thing.

Dislike

The project I dislike is the phone with fingerprint recognition on its backside. There will be so many situations that you are not convenient to unlock the phone from the backside, such as when you are eating with food on your hand you are not able to pick your phone up from the desk, or while you are driving you put your phone on holder like the picture below. Therefore in a way of practical it is neither a good interaction design nor a great interactive project.

Phone with Fingerprint Recognition on the back side (https://item.jd.com/33211230668.html?jd_pop=cfc36fd8-bab6-45bd-b4bf-51c40d174d70&abt=0)

Phone holder on car (https://item.jd.com/2052097.html)

 

Research Project (Group)

Firstly we were thinking about things that would be used in 2118, but not something like aircraft since it has already been designed in so many movies and cannot perfectly fit the concept of “interaction”. Then Tianchang Wang and Annie raised the idea that we can make something for babies—since sometimes they are so annoying and we cannot deal with them, this problem really should be solved in 2118. Annie has a younger brother, and she always finds it hard to communicate with him since she does not know what her brother is talking about at all. Therefore, we planned to make a device that can help parents/siblings to interact with little kids who cannot speak and express themselves. In the process of brainstorm, we also found that the device could also be applied to the interaction between owners and their pets, to contribute each other’s life to the greatest extent.

For the device that can read the expression/emotion from babies/pets, we thought up something like a little wireless magnetic sheet that can send signal. In order to show the prototype we make a helmet with the magnetic sheet on it.

For parents/owners, there would be an app on your phone that you can see what your baby/pet wants. For prototype we made a screen also with the wireless magnetic sheet on it, to receive the signal from the helmet. After making sure the prototype we needed, we started working.

 

Below are some pictures and videos when we were making the prototype.

 

 

 

Week 4: Interactive Chair Project: Rainy Nap Chair – Rosie (Liu)

Name Rosie Gao

Instructor Chang Liu

Project Interactive Chair: The Rainy Nap Chair

As a part of my slumber museum, the rainy nap chair is an interactive project which helps accelerate and improve user’s nap with the sound of rain. When the user sits down on the chair and puts the headphone on, the flex sensor underneath the pillow will trigger the computer to play a 12-min soundtrack, which is of the length of almost a 15-min recommended nap time.

My personal experience of sleeping on rainy days gave me the idea of building a rainy nap chair. It is more likely for people to sleep with a raining sound as the environment background because it can cover the noises around and is more natural than simple silence. When people are planning on a nap, they often expect to fall asleep quickly and charge themselves effectively, which makes such a helpful nap chair necessary.

Here is the rainy sound you may hear from the headphone:

 

And this is a simple display of how the project is going to work:

There is still development space of this project, mainly on the choice of sensor. I tried the vibration sensor first, which was only triggered on the sudden move and would not make the sound continue. So I choose flex sensor instead, which can keep its statement while being sit on. However, in real time experience, the flex sensor does not seem to be sensitive enough. The force sensor, FSR, may turn out to be the best choice among all.

//Processing

import processing.sound.*;

// IMA NYU Shanghai
// Interaction Lab


import processing.serial.*;


Serial myPort;
int valueFromArduino;
  
  SoundFile file;
  String audioName = "rain.mp3";
  String path; 
  
void setup() {
  size(500, 500);
  background(0);
  
path = sketchPath(audioName);
    file = new SoundFile(this, path);
   
  printArray(Serial.list());
  // this prints out the list of all available serial ports on your computer.
  
  myPort = new Serial(this, Serial.list()[ 3 ], 9600);
  // WARNING!
  // You will definitely get an error here.
  // Change the PORT_INDEX to 0 and try running it again.
  // And then, check the list of the ports,
  // find the port "/dev/cu.usbmodem----" or "/dev/tty.usbmodem----" 
  // and replace PORT_INDEX above with the index number of the port.
}


void draw() {
  // to read the value from the Arduino
  while ( myPort.available() > 0) {
    valueFromArduino = myPort.read();
  }
   println(valueFromArduino);
   
if (valueFromArduino == 1)
{
 file.play();
}
else if (valueFromArduino == 0){
 file.stop();
}
}

Recitation 4: Research Project (Group) – Qianyi Chen(Marcela)

Part 1 – reflection on interaction

 

My definition of  “interaction”:

Reflecting on the readings and previous class experience, my understanding of “interaction” has been enriched. From my perspective, the essence of “interaction” is “communication”, which means the circle of input-process information-output between several actors. The more communication, the better the interaction can be. To be more specific, I would like to define interaction at three levels:

  1. Basic level 

One example of this kind of interaction would be the switch of the light. You can only choose between two options (turn on/off) and can’t require further interaction by simply pressing the switch. It does follow the pattern of communication, but the interaction is just a simple loop and the interaction is limited.

2. Intermediate level

At this level, the users(input) would have more options and they don’t necessarily input the information themselves. That is to say, the output device can interact with the users by sensors or other devices that detect the information the users want to send. But the limit of this kind of interaction is that it just convert the information and it still depends on the user to make the response.

3. Advanced level

The interaction between AI and human beings is at this level. Different from other forms mentioned before, the actors of output in this kind of interaction does not only follow the command of the input. Instead, it may “create” something new from the input rather than simply use the information it received. Moreover, at advanced level, the communication is continuous. Every time when the device receives new information, it should be able to make self-adjustment. In this way, the output device can also “memorize” previous data so that it will get more and more familiar with the behavior of the user and make better interaction.

 

Selected project:

1.https://www.creativeapplications.net/openframeworks/encounter-suspiciously-curious-robotics/

This is the project I like. Basically, it’s an interactive mirror that tracks the motion of people. Therefore it is at the second level of interaction, which provides different responses to the user as if you interact with a cute animal. I also like the purpose of this project which is to “make machine behaves like living creatures”. It explores the way we perceive other lifeless objects and make attempts to reform the experience. Looking at the device from a different perspective will also enable us to make machines that better interact with people.

2.https://www.creativeapplications.net/processing/interference-dac-cross-medium-wave-interference/

The reason why I dislike this project is that I think the interaction between people and the device is limited. From what I saw in the video, the device collects information from the environment and convert it into wave interference and some kinds of simple electronic sound. If I were there in face of this device, I would feel disconnected with it and want to see more different responses from the device.

 

Reflection on Group research project – iCloud

 

Inspiration

During the brainstorm, we found that many people had trouble finding a suitable umbrella. We often encountered scenarios when our umbrella is not big enough or can’t resist the strong wind. Therefore, we intended to create a new kind of umbrella that can solve these problems. Then comes our project – iCloud.

Having faith in the advanced technology in the future, we imagined that there will be such kind of anti-gravity high tech that can make the iCloud float above the head. And there will also be such kind of material that is very flexible in size and can resist water, ultralight, and strong wind.

 

Functions

The functions of iCloud include three types of interaction:

  1. Interact with people: self-adjusted size, daily emojis

With sensors at the edge of iCloud, it is able to detect the figure of the user and automatically change to the size that is big enough but won’t occupy unnecessary space. When the user goes indoor, iCloud can be compressed into a tiny ball that small enough to be put in the pocket. The users can also express themselves by posting their daily emojis on the iCloud, just like what people do on the twitter of Facebook.

2. Interact with the environment:  PM2.5 indexUltraviolet index, Sunny/Rainy/Windy mode, GPS system

With internally installed internet, iCloud can collect environmental index and project the information right in front of the user and give some advice on clothes and activities just as some weather APPs do. iCloud can also change its material according to different kinds of weather. For example, when it turned sunny after the rain, the material will change from water-resistant to ultralight-resistant and become more transparent.

3. Interact with iCloud: make friends/communicate with iCloud

There will be interaction between iCloud users. For example, when two people are heading for the same destination, they can choose to “mix” their iClouds into one iClouds and go together, which is an interesting way to make new friends. And the emojis on the iCloud can also interact with each other: they can choose two different emojis or one emoji that represent their shared mood.

Concerning my definition of interaction, this device is at the advanced level of interaction. The emoji function fits the intermediate level of interaction and the function that build social networks raises it to a higher level. It not only reads the information from the user and the environment but also records the data of the user in order to provide better user experiences. One thing we are proud of about this project is that we not only create interaction just for fun but make life easier.

Color Music experiments reflection // Konrad Krawczyk

The history of 20th century color music experiments, as presented by the reading and the Lumia movie, is pretty complicated. It involved a difficult pursuit of funds, audience and broad recognition. As with most good ideas, there were several people at the same time who attempted to bring it to life. In case of Fischinger, the idea collapsed because of a disappointment of the Baroness, who didn’t appreciate the fact that the instrument was not self-contained. The opposite was true for Lumia – and thus, the instrument was easier to use and deliver great performances for a broad audience. This competitive process involved significant losses on the side of Fischinger, as all of his compositions got lost. This is an example of how creativity and artistic expression often goes to waste when encountering the the economic and social reality.

The point at which it failed was the assumption that it could become a mainstream product for people to keep in their houses. As much immersive and relaxing as it might be, it did not serve a practical purpose (obviously) and it did not make proper use of the snob effect, as rich people would not decorate their houses with such an expensive and complicated machine.

Yet, the technical idea was very much correct. Sound and vision go together extremely well, and it is not easy to achieve high-quality visual effects using merely a projector. Surprisingly, this holds true to this day. A few months ago I met an artist in Amsterdam, whose father was one of the few remaining artists creating analog lighting and visuals for performances and theater. I was surprised to find out that there is still a great demand for this kind of technique, even though so much can be achieved with digital lighting and mechatronics, at a lower cost.

This made me think of a possibility of creating a digital-analog mixed machine that would operate sound and programmatic logic from Max, and serve visuals using an analog medium.

Recitation Week 4—Ziying Wang (Leon)

My definition on Interaction changed during these weeks. My original understanding of it was just “input” and “output”. When a commander gives an instruction, the device interacts by performing the order. Then I discovered that interaction design involves several layers, ranging form designing to prototyping. An Interaction engineer needs to come up with a problem and several solutions, choose the best one and start his/her prototyping.

I’d like to point out an interactive design that I dislike. The vibration on my cellphone. Firstly, with both the lighting effect and the sound effect, the notifications seem hard to be ignored already. The vibration function seems extra. Second, when I put my phone on a hard surface, sudden vibrations can cause loud and disturbing sound. Additionally, some apps are using the vibration function without limit, there was a game I played on my phone before, the developer simply set the vibration to go with every action you perform in the game. It is terribly disturbing when my device keeps vibrating in my hand.

An interactive design I especially like is Forest app. I use it as an efficiency app. It plants a tree every time I set a fixed time, during which I’m not allowed to use any apps on my phone, or the tree dies. It effectively corrects my downside of overusing my phone.

The group project we design is AFAEM (Automatic Food Alteration and Evaluation Machine). We are always having trouble in finding the best flavor in the food we eat, there are always adjustment we want to make to our food. Our group designed this machine that consists of a mind-reading helmet that can detect your need in flavor and a box that both has a screen presenting your feeling towards the food and a machine arm that adds flavoring to your food. We design this instead of a machine that automatically cooks your ideal food because we believe that anything ideal can not keep being idealistic, one day the user might get tired of the “ideal” flavor the machine calculated for him, we want to keep the adjustment with the pace of the user’s mind. The box and the helmet convey information through signals.

Here is a prototype of our design

Synesthesia response // Konrad Krawczyk

The text is certainly a comprehensive enough beginner’s guide to synesthesia. I was somewhat familiar with the concept since having read a book Bitter in the Mouth, which was largely an autobiographical story of experiencing the world in atypical ways. The main character, Linda, is coming of age while having to struggle with her own perception, and the way it interrupts her easy navigation within the world. The protagonist has experienced a particularly difficult form of synesthesia, where words mixed with flavours, for example the word “disappoint” was associated with “corn on the cob”, and the flavour was strong enough that she could not speak without having those mental associations come up. This is a somewhat severe case of synesthesia. Now, I think that one can put synesthesia on a spectrum, where Linda’s case would be more near the extreme, while many, many of us would experience some mild form of synesthesia.

In fact, after some longer consideration, I feel like I might personally be experiencing some mild forms of synesthesia. However, it does not make my life harder (actually associative memory does me lucky favours sometimes) and I’m definitely not experiencing hardships that Linda does. For example,  my brain thinks of numbers and associates them with both colors and genders.

1 – icy blue – neutral
2 – brown – male
3 – red – female
4 – yellow – male
5 – orange – male
6 – bright green – female
7 – deep blue – male
8 – pink – female
9 – violet – female

Again, I don’t know exactly how much of it is caused by factors like the shape of letters, or early childhood associations with certain digits. Curiously, numbers like 3, 6, 8 and 9 all have pretty round shapes and are all female. I definitely can’t think of the reason for association with colors, but it could have something to do with the way these words sound.

Is this perception that exceptional, after all? I doubt it. The Booba and Kiki experiment has showed clearly that most people are able to make sound-vision associations when presented with two choices. Certain words like “freezing” are very easy to associate with the sound one would make when experiencing a condition they describe. Perhaps, the language has originated from the synthetic capabilities of early humans.

Recitation 4: Research Project, Yinqi Wang (Frank), Professor: Eric & Young

Recitation 4: Research Project

Individual Part

 

 

  • my definition of “interaction”

My definition of “interaction” has been changing. Differing from what I simply thought about before, a conceptual description involving input, output, processing, “interaction”, now, for me is becoming more and more difficult to explain. However, a successful interaction, from my own perspective, has these three characteristics:

  1. It is expected to provide everybody with a chance to create or participate in the project. For instance, Rafael Lozano-Hemmer, “Pulse Room” that a room full of hanging incandescent lamps, which will be blinking with the rhythm of the heartbeat that users uploaded.

  2. It is better to be a platform or shared space that allows not only one person to get involved but can achieve a mutual interaction. For instance, the interaction device “the Box” in  2nd floor NYUSH academic building is a perfect example, for it allows students from every region of the world to share their moment in “the Box”

    the BOX


  3. Its design needs to consider different users, with different background and ability.  What Apple designed for their users is really inspirational. Apple-Accessibility-Sady

 

  • The project I like

    The project I like is not a typical interaction project, for it doesn’t involve in any technology. But what I think is that “interaction” is our purpose, the high technologies are all useful tools for us to interact with each other. “The Elephant House”, where JK Rowling finished her first “Harry Potter” graffiti on the wall of the toilet.

The Elephant House

 

Graffiti on the wall

 

 

The reason why I like it is that it is a natural interaction among Harry Potter’s fans all over the world. And it built up a unique vibe among people whoever walked inside. In this small room, you can be a creator (input), to express your feelings and understanding of this fantastic novel, or you can act as a traveler (output) to absorb what has been drawn on the wall. The interaction for me is not only a process to provide people with entertainment or help, but it also gives everyone the opportunities to create their own interaction.

  • the project I dislike

    The project I really don’t like is the cell phone. There is no doubt cell phone dramatically changes our life and it is such a helpful equipment that now we can barely live without it.  The things that I dislike is its enclosed form. When people focus on the cell phones, they fully cut themselves off from the surroundings. Even if they have an adequate interaction with the cyber world, but they get lost in the real world.

During recitation, I really like the performance of the iCloud. If there is any solution, I think iCloud is a really good way, because it is an open interaction (If you want to share), which allow people to connect with the media world and the real world the same time.

Group Part

 

  • description of our project “the memory forest”

The Memory Forest is an equipment in 2118 where people can upload, download, erase their memories. And it can print things that you showed in your memories. This is a place that you can share, store, and even change your memories. The huge amount of memories construct into a huge forest!

 

 

  • derivation of the idea

The idea of “The Memory Forest” derived from the movie Avatar. In the movie, there is a tree of souls which preserve all of the memories of the ancestors. It really inspired us, for it is such a vivid and meaningful interaction! Sharing memories is much more efficient and powerful, for it can maintain the emotions and experience. And this type of interaction can connect people more tightly.

  • problems we met during preparation

    The Biggest three problems we met are:

1. We cant make the pipe stand on the cardboard vertically. At last, we have to use a chair to tight another wire on it to keep its balance.

2. We don’t know how to present our project by performing.

3. The “tree” we built, at last, is not as beautiful as we thought. We should have drawn a schematic first on the paper.