mac online apple blackjack http://www.euro-online.org

Digital Media – Final Prototype

DIAGRAM

 Prototype the Structure

Several custom built hardwares and advanced computing techniques had been used to build the interface of this project. The physical structure consists of two basic modules which are, FTIR interface and Cymascope. Each module has almost the same body and when combined together, they create the entire installment. Additionally an Arduino microcontroller located inside of the FTIR module that controls most of the events happening inside the prototype.

The top surface of the FTIR module consists of 35 by 25 centimeter piece of 10mm thick acrylic glass. Also, the frame that holds the glass in place is covered with a custom made array of Infrared LED’s. These special LED’s emits only infrared light which is not visible to the human eye. A similar system could be built with normal LED’s however, it would cause serious problems such as, being affected by natural or ambient light, as I experienced in my previous prototypes.

To be able to put different materials on the glass, and provide a tactile input to the spectator, a complement surface had been made by using Tinkerman method. Complement surface consists of a waterproof silicon, which was applied to a plastic film by using a soft foam roller. Yet, this process creates a texture very similar to human skin and responsive to the FTIR surface.

The materials that create a texture on the FTIR surface are, mat (represents the distortion effect), bubble wrap (noise effect), soft towel (ambient echo), and table cloth made of synthetic cotton (delay effect). Pressure that spectators finger will apply on these materials, going to measured by a touch sensor located below the frame and going to set the effect level. As the spectator touches on the materials, relative effects will be triggered and applied on the ambient sound.

FTIR surface video can be found on this link: https://www.youtube.com/watch?v=D26N-rHWL_s

An Arduino microcontroller used to operate components of the prototype such as, LED’s and pressure sensor. Basically, it has three tasks to do. First of all, controlling the IR LED’s condition, whether they are switched on or off, to decrease power consumption. Since IR LED’s are 1.5 volts, an octocoupler used to separate two circuits that are working with different voltages. Secondly, controls the color of RGB LED’s to create unique color mixture on the liquid holder. Finally, gets data from pressure sensor which is placed under the acrylic frame.

Cymascope module of the installment consists of a black acrylic liquid holder, a speaker, sound transmitter tube, membrane and RGB LED’s. The final solution to transfer sound waves from the speaker to liquid is created by the influence of tonoscope. One end of the tube glued to the speaker and the other end enclosed by a flexible membrane. Thus, any interaction between the air inside and outside of the tube had been blocked. As a result, the motion created by up and down movement of the speaker can directly be transferred to the liquid holder. Ultimately, according to the vibration frequency different patterns can emerge on the liquid surface. Liquid holder has chosen to be black, in order to reduce reflections coming from other sources rather than LED’s. The reason why the RGB light sources located on the sides of the liquid holder is to make colorful patterns visible from all sides.

Cymascope video can be found on this link: https://www.youtube.com/watch?v=fs0oehisD8U

 

Colorful Cymatic Patterns

Sound level creates different color variations, also speaker placed under liquid holder creates emerging patterns on the water. Sounds of “city traces/soundscape city diary” (https://www.youtube.com/watch?v=tS3JNgok5n8) from youtube was used as a sound source.

https://www.youtube.com/watch?v=fs0oehisD8U

 

FTIR Interface – Blog Tracking and Sound Manipulation

https://www.youtube.com/watch?v=D26N-rHWL_s&feature=youtu.be

Digital Media Proposal – Multi Sensational Sound Installation

cymatics_hans_jenny

Multi Sensational Sound Installation

The intention of this project is to extend the perception of people about sound in a way that using three senses, seeing, touching and hearing. The main inspiration comes from synaesthetic people who can perceive their world with multiple senses. This project will enable a normal person to feel the sound like a synaesthetic person by using an interactive medium. This is going to be a table setup that consist of a special lighting system and sensors.

The idea is grounded on two foundations, which are making the sound visible and letting people get into interaction with sound. Primarily to make the sound visible, the modal phenomena Cymatics will be used. Cymatics is a study to make sound visible propounded by Hans Jenny. Basically if the matter, such as a cup of liquid or granules (ex. salt or sand) attracted by the sound -according to the physical properties of holder- unique patterns emerge that allow people to see and discover the unseen world of sound. For this project, water is going to be used as a matter and a special light setup will project the patterns from the water surface to the space.

In order to control the sound, hand movements will be used, then the motion of hands will be captured by ultrasonic sensors and gyroscopes. The audience will get into interaction by using two hand gloves and each hand glove will consist of an ultrasonic sensor, also a gyroscope. Gyro in the one hand will control the type of sound wave (sinusoidal, triangular or rectangular) also, it will be possible to make transitions between waves by rotating the hand on the X and Y axis.

The other hand will be controlling the ambient light and the color with the same way. The Arduino micro – controller is the component which is going to transfer the data taken from sensors to the computer for the process. Later on, the data taken from Arduino is going to be used to create sound frequency in processing. For this purpose, the minim library in processing would work fine. Moreover, for lighting series of RGB LED’s are going to be operated by an Arduino which will be placed beneath the liquid and project the refraction to the space. Besides, the ultrasonic sensors will control the amplitude and wavelength. The distance between a solid surface and hand gloves will define the amplitude and wavelength. Hands and especially fingertips are the end of the nerve system, so contains a lot of receptors and, that is why so sensitive. In order to extend the perception one step further, vibration motors on the hand gloves will vibrate according to the change in the amplitude and wavelength.

This project may have a drawback and it may require a lot of time to accomplish. Projection of  the refractions on the water needs special conditions also a special lighting system. Presumably, finding the proper way of combining the lighting will be the most challenging part of the project.

Overall, this project will provide a multi sensational experience to the people by combining visual, tactile and audible perceptions and allowing people to get into interaction with them.

My Cymascope Proposal

Reference:

Image: http://dataisnature.com/images/cymatics_hans_jenny.jpg