[HSS8121] – Presentation document

Posted in Uncategorized on June 9th, 2016 by Yue Wang

幻灯片1 幻灯片2 幻灯片3 幻灯片4 幻灯片5 幻灯片6 幻灯片7 幻灯片8 幻灯片9 幻灯片10 幻灯片11 幻灯片12 幻灯片13 幻灯片14 幻灯片15

[HSS 8121] – Research on the interrelationships between facial expression, colours, and emotion Research Proposal

Posted in Uncategorized on June 9th, 2016 by Yue Wang

This proposal is composed of seven sections, the first part is introduces briefly what I would propose to do in the research, what kind of other research has been conduced in this area, and the general overview for this proposal. The second section mainly focus on the define the research questions, issues or problems, it lists the what questions I want to find answer of this study. Such as different facial expression link with basic emotion (happiness, sad, surprise, disgust, angry and fear) can be describe for what color or if we use opposite colors add in facial expression dose it also meaning original human emotion? The third part of includes the aim and objectives of this research proposal, which explore the target that I want to be achieved and why I want to research it.

The fourth section discusses the what research method I should employ, for example in the class we have learned four research method: Ethnography, Practice based research, Video analysis and Media archaeology, and why these are the particular approach chosen. The fifth section describes the literature review and background studies, what other research is being conduced in this area. The sixth section analysis on what knowledge I learned from this research proposal and used into my “LATES” events design for “In Your Face” exhibition. Finally, the last section concern about the conclusion and future development of this research proposal. Summary of whole proposal and review which problem I can answer or which question still need thinking about.

Problem Formulation

The first important question in this research proposal should be addressed is what kind of interrelationships between facial expression, colours, and emotion? As Cole and Moore (2014) points out, particular at infant facial activity express specific emotions, at early social interaction, without talk, facial expression have important relationship with emotion. Form other point of view, Gil and Le Bigot (2015) has examined that effect of colour background on the processing of stimuli is important factor in human interactions. Moreover, Geovany, Olac and Stephen, et al (2014) argues that human display emotion through different channels such as head poses, bodily gestures, head poses, speech prosody, and facial expression, but also through physiological signals, such as colours changed stimulate. Different colour might be evoke some specific human emotions, like red evoked people feel happiness, black evoked people feel sadness or fear. Some colours predict human emotions higher than other colours, such as when people look at red, the emotion effect higher than people look at blue. Color & Paints Interim Meeting of the International Color Association ( 2004) has reported that color can relate our emotion and feeling, matching colours (such as red, blue) to a certain number of emotions (such as angry, sadness), the data about emotions reaction to colours will be assessment. However, those research all study about two elements relationships whatever between facial expression and colours, between colours and emotion, or between facial expression and emotion. If three elements together appears, what kind of interrelationships they have?

 

The second question is how the human face recognition system to identify people’s facial expressions and emotions? Does people’s facial expressions eventually express the content is person’s emotion? For example, Barrett, Mesquita and Gendron (2011) has shown that facial expression is one of the main external form of expression of emotion, in order to guide the individual behavior of social situation have suitable interaction, people need correctly extract the corresponding emotional information from other people’s face. In real life, the facial expression maybe not happen individual, it is always associated with the particular situation and with particular emotional appeal. If we want to accurately identify the emotional state and to gained real meaning by the face expression of other peoples, we must identify the current emotional situation and integrating it with facial expressions.

The third question is does opposite colours will create mood illusion for face recognition? This question possible hardly to resolve, because I have not find some research suggestion correctly talk about opposite colours and mood illusion for human face. Just found some experiment from Yong, Sudirman and Chew (2012) investigate that the interrelationship between colours and facial expressions in order to realize the result acquired in psychology, art and design.

Research aim and objective

The first aim of the research proposal are try to solve the three questions above-mentioned, understanding the knowledge relating to the questions, and seeking to enhance knowledge from other people’s research.

The second aim of the research proposal are use the knowledge I researched to enhance my “LATES” events design for “In Your Face” exhibition. If I known the relationship between facial expression, emotion and colours and each factor’s specific function, it is possible I can improve my events activity design’s quality. For example,  reasonable arrangement for each factor in my design make it more effectual, in order to enhance audience events activity experience, which part of design should use colours change to guide audience’s facial expression change and create different emotion.

The reason why I attempting to do this research is I really interesting in facial expression, emotion and colours. In last year, I have a photography work named ‘ Half water, Half fire’, this photography works shown the opposite colours covers people’s image, when the colours effected on image, the photo’s original emotion will have change, even the people’s facial expression in the image have not change, but you will have totally different feeling with two same photo. Also, I think opposite colours can enhance audience’s feeling and emotion when they see the different facial expression on photo. But when I done this work in last year, I do not know this kind of knowledge, this research remind me rethinking about this project and want to find the develop for this practice based on research. Moreover, if change this photography work to be a events activities, what interaction I want to make with audience, how did I to redesign this project? So I really want to research on this area and find the knowledge improve design.

Research method

From HSS8121: Enterprise and Research Methods module, we have learned four research method. The first research method is Ethnography, as Hammersley and Atkinson (1983) point out that ethnography is an significant approaches using with social research today. In the early time, ‘ethnography’ was often seen as complementary, which referred to historicial and comparative analysis of no-Western societies and cultures. After that time, ‘ethnography’ refer to an integration of two part of, one is the first- hand empirical investigation and the theoretical, another is the comparative interpretation of social organization and culture.

Moreover, what ethnographyers should do? In class John has mentioned that Ethnography have three factors, firstly, Features include naturally occurring settings, ordinary activities, social meanings, the perspective of the participants, member categories, descriptive, participant observation and reflexivity. Secondly, Data to be covered: 1. Multiple data sources. 2. Interviews, observation, note-taking, video and audio, documents and artefacts. 3. Coding. 4. Qualitative, interpretative analysis. Thirdly, Disciplines about anthropology, sociology, concern for the underdog, and ethnography in CSCW, HCI and design.

In this question – what ethnographyers do? – Hammersley and Atkinson (1983) has more details mentioned, for example, they think in term of data collection, ethnography regular involves the researcher participating, overtly and covertly. In the everyday life, listening to what is said, watching what happen, or asking question through informal and formal interviews, collecting documents and artefacts.

The second research method is video analysis. When we use this research method, we need think about uses, features, conversation and video analysis. Different from other traditional research method such as interviews and questionnaires, as Heath et al. (2010) concerns that the research method for video analysis need taking the participant’s points earnestly and the resource from their dayliy activities. For example, when audiences presenting these of data, need pay attention to the selection of relevant examples, multiple fragments, presenting single and the graphical representation devices. For research method video analysis, we should not only focus on uses evaluative, formative, rethinking ‘interaction’ and related concepts, but also concerns about data transcription, look for phenomena of interest, and qualitative, interpretative analysis. Moreover, we need think about how activities are socially organised through speech, body movement, gesture and engagement with objects. When we do the recordings, maybe use multi-camera, shot a broad static, not the same as promotional or documentary video.

The third research method is Practice Based Research, this one can be more easy understand than Ethnography and video analysis.

The fourth research method is Media Archaeology. As Lovink (2003) argues that media archaeology is first and foremost a methodology, a hermeneutic reading of the “new” against the grain of the past, rather than a telling of the history of technologies from past to present. This research method might be use in electronic practice, art practice or pedagogy.

Following those four research methods, I think the research method Ethnography, Video analysis  and Practice based research I should employ. The reason I chosen Ethnography because in this research proposal, the interrelationships between facial expression, colours, and emotion, particularly I need participation, overtly and covertly, watching what happen in my “LATES” events design for “In Your Face” exhibition, collect the data from audience’s reaction. Moreover, I should combine with the research method Practice based research, to form a positive circle. For example, do research, practice, deeply research main question from practice, found the answer and practice again, participant observation practice activities, then collect data and analysis, found the new problem and research again to solved. The reason I chosen the research method Video analysis because the main basic design for this research is a photography work, I need use this method to analysis multiple fragments and take the graohical representation. In addition, rethinking ‘interaction’ and concerns about the photo meaning transcription.

 

Research review

Yong, Sudirman and Chew (2012) have an experiment about colour perception on facial expression towards emotion, the experiment used emotion wheel and six universal emotion (happiness, surprise, anger, disgust, fear, and sad). The experiment ask participants select a single colour for the each of the seven faces. Face is expressive of the six basic emotions and the neutral, the six emotions are not named (Fig.1).

图1片2

2图片2 12图片2 122图片2

Source: Yong, C., Sudirman, R. and Chew, K. (2012). Colour Perception on Facial Expression towards Emotion. TELKOMNIKA (Telecommunication Computing Electronics and Control), 10(4), p.783.

The whole experiment data results shown the concordance among the observed expression of human emotions, colours and their relationships. If I can collect more picture have various emotions more subtle and emotional, it might be more clear about the answer. A valuable color accessories at facial expression picture maybe can find more data form audience emotional state, feeling, emotions, mood, cognition and connotations. Form this experiment, as Yong, Sudirman and Chew (2012) point out that design should select colours to be more objective, each of the colour represents the consensus of the perception are different, designer can used this point to guide their works.

 

 

[HSS 8121] – Creative Entrepreneurship Project Report

Posted in Uncategorized on June 9th, 2016 by Yue Wang

In this creative entrepreneurship project report, have three sections was reported. Firstly, this report will focus on introduce my “LATES” events project and activities design for “In Your Face” exhibition include description my work, detail for the events design, picture analysis and events themes choosing. Secondly, thinking about the course knowledge link with my research proposal discuss how I used research method on my design. Finally, is a technical rider for what I need in the exhibition maybe prepare from National Media Museum and a biography of myself positioning my practice.

In Your Face: “LATES” events activities design

As the exhibition messages mentioned that we should present engaging projects of LATES evening events connecting adult audiences and following four exhibition themes: reading faces, changing faces, beautiful faces, and choosing faces. Explore how human and machines interpret different faces and facial expressions, why people change their faces, how people analysis their perception of beauty and why people represented their face as portraits. The projects I want to presented is my work “Half water, half fire”, it is a photography project, link with this project have two audiences interact activities design.

Photography project “Half water, half fire” is a series photos that focus on explore human emotion, photography colours change, and contrast vision (Fig 1 and 2).

图片1图片1

 

In this project, the mainly colours are red and blue in one photo’s two layer, it is seems to be one photo have two portraits display. When we look at it use red card, will see the blue layer for the photo. Instead, when we use blue card would be see the red layer for the photo. Each layer in photo is different facial expression with different emotion from model. This processing for the visitor, possible is a method to choosing face and changing face, because when user decide to use which card will decide what face image and model emotion will be shown. If they don’t use the colour card see it will have a confusing and contrast vision, but I think audience still can feeling the model’s mood and strong visual impact.

Because this is a past time project for me, in order to make it suitable for the LATES evening events I have three pieces of development for the project based on my research proposal. One part of development is in the exhibition, this series of photos might be focus on portrait’s part of face, not shown the half-length portrait. This might meaning model’s facial expression and face will be more clearly and directly. One development is I will shot some new photography in same style not only have six basic facial expression emotion (happiness, sadness, surprise, anger, disgust, fear) with portrait, but also have more kind of facial expression such as crazy, indifference, confused and nervous. Another part of development is set three pairs of contrast colours, original pair of colour is red and blue, added two pairs of contrast colour is yellow/purple and green/orange. Visitor will have more experience from different pair of contrast colours and facial expressions, moreover, when they join follow-up activities will have more way to choosing in their own photo.

In the exhibition events, my plan is have a independent space to show the photography and running the activities. For example, following figure 3, photography have two ways to display: one way is use projector show at wall (number 1 area in the figure 3), another way is use large-screen (number 2 area in the figure). Those two screen will connect with computer scrolling play different images, the large-screen will also use to following activities, when audiences take same style face photos they can choosing their face scrolling play at large-screen if they want.

Activity plan A is virtual face photo shot, in the exhibition events I will prepare two cameras for audiences, one is digital camera connect with computer, audiences would be join the activity and choosing different “Half water, half fire ” filter style (red/blue, yellow/purple, green/orange) to take face photo, in this part of section, audiences required to do different facial expressions, preferably do two contrast face expressions, for example, one is looks like really vitality, another one is tired. In our common sense, vitality always presented use green, but I will suggest continue use contradictory method to show, such as matching tired facial expressions to green. This approach maybe make face vision effect more strong, enhance audience’s experience. Because every element part of this design is contrast and people can changing it.  After photo shot, audiences can choosing the photos show at the events, scrolling play at large-screen.

Activity plan B is real face photo shot, another camera I prepare for audiences is Polaroid camera (number 4 area in figure 3), and support different colour card(red/blue, yellow/purple, green/orange). People who join the activity would take face photos and get it immediately, when they get paper photos, they can use colour card try to look at different kind of face and find themself completely different side. For example like figure 4 and 5. It will become strong feeling experience for audience. If they want to put the paper photos show at events will have a part of stage (number 3 area in figure 3).

图片2

 

图片3

 

Based on the project and activity design, I think the exhibition themes which I can be explore is Changing Faces and Choosing Faces. During the activities, audience will continue make decision on change their faces or choosing face, even the activities plan without make-up, but when people use the colour card or choosing “ Half water, half fire” style filters to show their faces, multiple emotion experience still in their mind.

 

Analysis the project with the Module knowledge

Before I developed change the photography project “Half water, half fire” suitable for this exhibition events, I have do some research of the interrelationship between facial expression, emotion and colours. Because of some questions I cannot found answers in my research proposal, I want to found it in this changed project, such as I need collect data from different audience’s reactivity, feeling and photos use the research method Video analysis. Record the processing at events, take data transcriptions, look for phenomena of interest, and qualitative, interpretative analysis audience’s perceptions, actions, opinions and attitudes.

Moreover, I would to be a participant at activity and observe the people’s action, emotion and behavior in the processing use the research method Ethnography. Such as

Watching their color choices, listening to their exclamation when their face completely different shown and asking their feeling about the different opposite factors repeated combination of this design.

The reason for I add new pair of colors to this project is I want to find more variable factor in the activity, as my research proposal mentioned, multiple facial expressions, emotion and colour combine in one section, opposite elements (contrast colours, contrast facial expressions, contrast emotion) continue crash throughout in the design and activities, what audience want to say? How about their reaction? Why they take different choice for each opposite element? Maybe some questions I cannot answer but I might certain that visitor can get enjoyable experience.

Project and activities design technical rider

1. A bout 20 square meters space use for running activities and show the photography project.

2. Technical: large-screen and projector use for display photography project and showing audience’s activity photo.

3. Two cameras. One digital camera use for take virtual photo transfer by computer and display at large-screen (digital camera maybe I can prepare by myself). One Polaroid camera and photographic paper use for audiences take photos.

4. Five basic light and three photographic light use for make a little photographic studio light for audiences take face photos have better effect.

5. Five meter with four gang power strip more than three.

6. Two mini table and some cushion

 

A biography of my position

My project “Half water, half fire” focus on face photography and describe within colours and facial express emotion, it is might be a good way to shown the exhibition subject “Face”, two related activities design interacted with visitor focus on two exhibition themes: Changing Faces and Choosing faces. Playing with take photos, thinking with face change, choosing with inside subliminal, and feeling with opposite self, hope the project can make audiences get enjoyable experience.