Assignment 4 | Design challenges

Step 1: Mind map

We decided as a first step toward coming up with an idea for our project to write down ideas related to Emotions and Data Security. Since both topics are very broad we had to narrow the scope by grouping similar ideas or thoughts in order to determine specific categories - emotions in society, emotions in privacy, and emotion dystopia

Step 2: Challenges&Solutions

For every topic we thought about the following challenges which interests us:

Emotions in Society:

We are interested in how exactly society affects our feeling so we can better grasp how we’re influenced.

Challenge:

Depict influence from society.

Solutions:

1. Link social interactions to emotions to understand how and what influences them

------------------------------------------------------------------------

Emotions in Privacy:

We are interested in how can we be fully aware of our own emotions.

Challenge:

How to get used to and be consistent/open in expressing our feelings and emotions to consciously understand what is causing them?

Solutions:

1. Write down how you feel

2. Draw forms representing your emotions

3. Use colors corresponding to different emotions

4. Record verbally how you feel

------------------------------------------------------------------------

Emotion Dystopia:

We are interested in exploring where exactly lies the line between oversharing and “overkeeping” and whether being open with sharing our emotions with everyone and with everything can have consequences (Humanwise and Data-wise).

Challenge:

display dystopian features

Solutions:

??

Step 3: Presentation

Assignment 5 | Design challenge + Persona + Scenario

We decided to work in smaller teams, and our team concentrated on the second challenge presented in the previous presentation: Emotions in Privacy. We want to work towards inventing an object that can help people get used to sharing their emotions and feelings openly to be able to self-reflect and analyze what exactly is causing specific emotions and why. We did some research and decided to concentrate on people who have lost a loved one and due to that are feeling depressed. With our product, we want to help people from this user group become more aware of their emotions and help them learn how to deal with them. The crisp title we chose for our product is 'Self-reflector' and in the following presentation, the challenge, the user group which is then represented through a persona, a scenario, showing how the persona can interact with the product, and analog and digital characteristics of the product are presented.

Assignment 6 | Lo-fi prototyping

We created three different low-fidelity prototypes with different type of user input and output (visualization/feedback). 

1. First, we have a tree with branches in different colors representing each of the six basic emotions - fear, anger, joy, sadness, disgust, and surprise. The user can write on small notes how he/she is feeling at the moment and hang it on the branch representing the type of emotion he/she thinks is related to. The branches will grow when the user is hanging many notes on the it with the aim to visualize which emoitons are more felt and which more neglected. 

2. Second, we have a box representing metaphorially a treasure box. The user can verbally record his/her 'secret' emotions to it. When the user is not active the box will open motivating the user to record how he/she feels in order to close it. 

3. Third, we have a screen inspired by the foggy windows during rainy days on which almost all of us have tried to draw a smiley face or write a short word. The user can write on it how he/she feels and depending on the type of emotions the screen will change to a sunny view if the emotions are positive and it will stay foggy if the emotions are on the negative spectrum.

Assignment 7 | Testing

The task for this assignment is to evaluate our prototypes. Because each of our prototypes is different by nature (different input/output) we wanted to go one step backward and conduct interviews with future users of the product in order to investigate initially how they feel towards our project idea and then combine everything we derive from the interviews and create one unified product and then evaluate it, redesign it and refine it.

We interviewed different target users to understand and analyze various aspects important to our project such as whether they are aware of the complexity of their emotions or whether they want to consciously understand why they are feeling in a specific way in different situations. We also investigated whether the users do or would like to show openly their emotions and if they do it how exactly, and what would be the most convenient way for them to express their emotions - via talking, writing, taking photos, painting, etc… Also, if they had the opportunity to receive feedback and analysis of their emotions in what form would be most appropriate? 

The most important key findings from the interviews are:

- in solitary people sometimes recall and analyze when the felt emotion is very strong and negative; often everyday „small“ feelings are neglected

- almost every interviewee likes the idea of being able to self-reflect and be more aware of their emotions

- people often express their positive emotions but hide the negative ones

-  people sometimes can't control emotions in very extreme situations such as anger

- people rely on conversations with close friends/family when wanting to share their emotions

Additionally, we concentrated specifically on the input aspect. Different ways of input were introduced to the users and they were motivated to openly speak and say what they really think. The most interesting way for them to express their emotions was either by movement - more specifically to touch and move an object, or also by connecting emotions to colors.

input test.jpg

Assignment 8 | Interim Presentation

Assignment 9 | Plan

Our Plan/ Next Steps?

- Determine the ultimate design goals

- Decide whether we will have a questionnaire or an interactive object to collect the emotional data

- Find out how to quantify emotions and determine the type of data

- Determine the content and type of feedback

- Further prototype testing

- Decided on a final idea/concept and start realizing it

- Decide on code construction/ which database we will use

- Program writing tests

2. Questions from feedback?

- Whether the purpose of the design needs to be to make the user aware of their emotion type or just to achieve awareness of the emotion.

- Emotions are short-lived and difficult to capture, so the time period for recording emotions and the time period for feedback needs to be determined.

3. What potential key features of the concept do you need to implement?

- Types of emotions

- Ways of recording

- Situations that trigger emotions

- Touchpoints that trigger reflection

- Reflections on the feedback received

4. What is feasible in the given time frame (final presentation 15.02.2023)?

- Prototypes that can be interacted with

- Displays that can show changes in user mood

5. What are you going to build?

- A device that records the user's unconscious emotions

- A reminder to provoke the user to think

- An interactive device that allows for the recording of emotions

- An emotion profile display that can be reviewed repeatedly

6. What materials might you need to create the prototype, and where do you get them?

- 3d printing, can be done in the school studio

- Knitted/soft materials

- Soft fillings: foam, cotton, etc.

- Materials for different touch sensations

- Arduino sensors

- Woven to realize prototypes in an interactive way

6. How and when will the project and prototype be documented?

- Documentation of the discussion process, documentation of the direction of the project

- Videos of the output phase of the program

- Documentation and video of experimental processes, program testing, prototyping

- Documentation of the final project presentation, posters, etc.

- Documentation of the program code in GitHub/GitLab

Assignment 10 | Data Definitions

Component diagram of the digital part:

incom_10.PNG

Synchronization:

synchronization.png

The user's emotional data is collected via an app - the user can enter his emotion, its intensity, and reason. In a database, all this information is saved plus the timestamp when the user entered the data. The app will send notifications to the user every day for a period of 30 days to remind him/her to use the app. When the handy and the object, which will visualize the data, are connected with the same Wi-Fi the data from the app and the data in a database on the device controller can be synchronized. The device controller (Raspberry Pi) controls the visualizations on the output device.

Design part

Product usage process

1.Using a classroom wearable device to detect changes in the user's skin resistance and to alert the user to record their emotions.(not sure steps)

2.Using the App, users set the time when they want to record their emotions. Then they anser the questionares, after that we can collect the datas.

3.The styles of data contact: styles of emotions, intensity of emotions and the reasons why users choose these emotions.

4.Giving users feedback:Data Physicalisation

Physical form of data

Lights and colors--styles of emotions

movement--intensity of emotions

(Different materials--styles of emotions

Temperature--intensity of emotions)

Metrials

3D printing--plastic

soft metrials--Plush material

App part

微信截图_20230111162924.png

Assignment 11 | Feature Freeze

18.01.2023

We were given the task to demonstrate our data flow by connecting some LEDs to an input method for our emotions. We were given the advice, to use LimeSurvey for the input, because it is simple and provides an useful API.

First, we created a LimeSurvey. We were told, just a few LEDs would be enough, so we choose three LEDs and according fellings. The feelings in the survey are color coded to match the LEDs.

The Code can be found here. It uses limepy to connect to limesurvey and get a csv file of the currently stored data. It reads in the whole file and stores the most recent input answer. Then it uses PWM to make the according LEDs shine with a brightness, that matches the selected intensity.

Video : https://drive.google.com/file/d/17zRb1C6Hs25OUWTZmlgA2OWKWGh1E9ZO/view?usp=sharing

25.01.2023

We continued our tasks. On the hardware side, we managed to connect to WS281X-Led-strips. These are individually addressable LED strips, in which each LED can get a 0-255 RGB value. It turned out to be a quite troublesome process. First, the LED strips in the e-lab are not labeled. The makes it hard to figure out what kind of strips they are and therefore which standards and wiring are required. We compared the strips in place with images from the web of different strips and identified them that way. We roughly followed this tutorial. We can now control the LEDs, but the process took so long that we did not manage to connect them to the survey.

01.02.2023

Last Wednesday, we were give the task to connect the strips from last time with the survey. Also, we needed some way to trigger the start of the output and decided on a button. Within this week, we added two more LED strips, because the final prototype is supposed to use 3 rings and vibration motors. The limesurvey was moved from the official lime survey side to the FU userpage.

08.02.2023

On the hardware side, this week was mostly spent with refining the already existing base. We went over multiple iterations of animations and added a loading animation for the API request. We originally wanted to already have the encasing ready so that we can try to stuff the electronics in, but we did not get a 3D printing slot soon enough. Because of that, only the top was ready, but that helped us to test the wool. We were very pleased with the results. It lets the light go through and feels nice and soft, giving the device a much more pleasant feel.

14.02.2023

This week was spent with creating the video and pictures, as well as fitting the electronics in the model. This was rendered a lot more time-consuming and nerve wracking by the fact, that our first print did not fit. We had to print again over the weekend and work hard to fixate and solder all the components to be ready for the exhibition.

TEXT - DRAFTS

VERSION 1:

Time passes by while being occupied with our everyday tasks - we get up, go to work, have an uncomfortable talk with our boss, do some sports, go to the cinema with friends, go to sleep, repeat. But when do we have time to stop for a minute, sit back, relax, and actually think about ourselves, how we feel and why we feel this way? Self-reflector can help you develop the habit of sharing your emotions so that you can be able to reflect and understand yourself and your feelings.

Self-reflector is designed in three parts - an app, which serves as a private emotion diary, a wearable device accompanying you during your everyday activities, and a physical object you can place in your safest private place at home. First, the wearable device measures your pulse constantly and triggers when a change in the pulse is detected to remind you to notice small everyday situations affecting your emotions. If you think that the trigger is related to a change of emotion, you can enter in the app how exactly and how strongly you felt at this moment and write the reason behind it. Later that day, when you get home, you can observe on the physical object the visualization of your emotions and their intensity via different colored lights.

Self-reflector helps you improve the understanding of your different emotions by making you think, share, and frequently reflect on them, their meaning, and their cause. Willingly, you can develop a more profound knowledge of self-reflection and self-awareness by noticing and expressing your emotions openly.

Being faced directly with your deepest feelings and emotions opens the door to understanding yourself better.

VERSION 2:

When you're busy doing everyday tasks, time passes by imperceptibly. You get up, go to work, have an uncomfortable talk with your boss, do some sports and so on. But when are you able to take a break and think about yourself and your feelings? Self-reflector reminds you to notice yourself. You can develop the habit of sharing your emotions so that you can feel connected to what's going on inside of you.

A bracelet monitors your pulse and vibrates if it detects a change. If you think the trigger is related to an emotional change, you can enter what specifically happened and how exactly you felt at that moment into an app. At home, a squishy pillow is waiting for you. It lights in different colors matching your recorded emotions during the day. If you touch it, you can physically feel how strong your emotions were.

The act of introspection allows you to objectively look at your thoughts, feelings, emotions, and actions. By doing so, you can gain a greater understanding of yourself and grow a compassion for who you are. Self-reflection is the key to self-awareness.

VERSION 3:

When you're busy doing everyday tasks, time passes by imperceptibly. You get up, go to work, have an uncomfortable talk with your boss, do some sports, go to sleep, repeat. But when are you able to take a break and think about yourself and your feelings? Self-reflector reminds you to notice yourself. You can develop the habit of sharing your emotions so that you can feel connected to what's going on inside of you.

The bracelet monitors your pulse and vibrates if it detects a change. If the trigger is related to an emotional change, you can enter what precisely happened and how exactly you felt at that moment into the app. At home, a squishy pillow is waiting for you. It lights in different colors matching your recorded emotions during the day. If you touch it, you can physically feel how strong your emotions were.

Introspection allows you to objectively look at your thoughts, feelings, emotions, and actions. By doing so, you can gain a greater understanding of yourself and grow compassion for who you are. Self-reflection is the key to self-awareness. So why not let Self-reflector help you in this process?

FINAL VERSION:

FEEL

- FEEL connected to your inner self.

When you're busy doing everyday tasks, time passes by imperceptibly. You get up, go to work, have an uncomfortable talk with your boss, do some sports, sleep, and repeat. But when can you take a break and think about your feelings? FEEL reminds you to notice yourself and helps you improve the understanding of your different emotions by making you frequently reflect on them.

The smartwatch monitors your pulse and vibrates when it detects a significant change. If the trigger is related to an occurrence of a specific emotion, you can describe its context in the app: What is happening? How do you feel? How intense are your emotions? In this way, the app becomes a private journal that accompanies you throughout the day. FEEL is placed at home, and when switched on, it lights in different colors corresponding to the feelings recorded in the app. By touching it, you can feel a vibration showing you their intensity.

Introspection lets you objectively look at your emotions, thoughts, and actions. By doing so, you can better understand yourself and grow compassion for who you are. Self-reflection is the key to self-awareness. Let FEEL support you in this process.

Design inspiration

Inspiration: soft materials and organic shapes

Initial solution 1: floral shapes, with colours and lights indicating the type of mood and the degree of opening and closing of the petals indicating the intensity of the mood.

Preliminary scenario 2: Simulation of a lying pet form, with vibrations indicating the intensity of the emotion.

Preliminary scenario 3: Simulation of a balloon form, lighting to simulate the form of a firework.

A timeline is set up to facilitate user control and selection of the point in time at which the lights are displayed.

微信截图_20230228035401.png

Design solution improvement and testing

After discussing the options, it was decided to remove the timeline and just use a more visual way of showing the different time processes.

The design has also been refined. A pebble was used as a reference and the idea of throwing a stone into water to create a splash was adopted. The light changes to a water ripple shape and the vibrations match the speed of the light changes to indicate the intensity of the emotion.

Once the general shape was determined, 1:2 scaled models were made using high-density polyurethane, and 1:1 equivalently sized models were tested.

Final modelling and production

After testing the model and defining the shape, 3d modelling and rendering were carried out, as well as model making.

The overall structure of the model was produced using 3d printing, with the upper part made of transparent PLA and covered with wool felt, which provides good light transmission while maintaining a good tactile feel in the hand. The bottom half is also made of PLA and is sanded and painted.

FINAL PROTOTYPE

User Journey

The user's pulse is tracked by a smartwatch throughout the day, and it vibrates when it notices a substantial change. If the trigger is connected to the occurrence of a certain emotion, the user may define the context in the app by describing what is going on right now, how he/she feels, and how intense the feelings are. Throughout the whole day, the user is able to write down in the app his/her emotions - like a private journal. When FEEL is switched on at home, it emits changing hues of light in accordance with the emotions noted in the app. The user feels a vibration by touching it, which reveals to him/her their intensity.

Components

- Smartwatch

- Questionnaire (App)

- FEEL

1. Smartwatch

An app is developed for a Fitbit smartwatch, which measures the user's heartbeat. Because there is a correlation between different emotions and the heartbeat, we wanted to detect a drastic change in the heartbeat, specifically when the heartbeat is above 100 bpm, and ask the user via a message on the smartwatch's screen whether he/she feels ok. A slight vibration is also activated with the message, so the user can notice something is happening. The idea is that the person is consciously aware of a detected change. It is up to him/her to decide whether the change is caused by a specific situation that causes particular emotions. If yes, via the message on the screen and the vibration, he is motivated to open the questionnaire and to record how he/she feels, how intense the emotions are, and the reason behind it. Additionally, on the screen is also shown how many times the smartwatch triggered the user that day so that he/she can have an overall look and compare the number with the number of recorded emotions in the questionnaire he/she made at the end of the day.

App's code:

The full repo can be found at: https://github.com/elkazelka/fitbit_app

fitbit_code_1.jpg
fitbit_code_2.jpg

App's interface:

2. Questionnaire (App)

A LimeSurvey questionnaire hosted on a FU server is created to collect the data needed for the visualization. From the questionnaire, the user can either select to see the visualization of his/her emotions on FEEL from a previous record by choosing a date in the past or create a new record. When making a new record, the user is asked which emotions he/she feels right now, how intense they are, and why.

LimeSurvey Link:

https://userpage.fu-berlin.de/~elit04/survey/limesurvey/index.php/463564

LimeSurvey Questions:

Question 1:

For the first question, we took the 16 emotions stated on the Geneva emotions wheel  (https://www.researchgate.net/publication/280880848_Geneva_Emotion_Wheel_Rating_Study). The colors of the emotions correspond to the colors from the wheel and the shapes are inspired by the main shape of FEEL - rocks or river pebbles.

Geneva emotion wheel.jpg
survey_question_1.jpg

Question 2:

The second question is related to the intensity of the chosen emotions. For example, when the user decides that he/she is feeling the emotions of interest, contempt, and anger, then he/she can choose a specific intensity for each emotion.

survey_question_2.jpg

Question 3:

The data from the third question is not used for the visualization part, but it aims to motivate the user to think about and write down the reason why he/she feels that way.

survey_question_3.jpg

App's interface design

The main content of the app interface includes

1. Main page: Shows the data recorded by the user on that day and the user can record emotions directly without referring to the detection data of the smartwatch.

2. Test recording, the data recorded by the smartwatch can be seen in the app and the user chooses whether to record it or not.

3. Three main questions for the user to record, and the page of this record is displayed after completion.

4. History page, the user can look back at the past emotion recording data.

3. FEEL

Hardware testing

The FEEL device is powered by a Raspberry Pi 4 running the python code. The Pi is attached to a button, 2 vibration motors and 3 LED strips. Since the LEDs need a lot of power, they are connected to an external 5V power supply.

schema.png

The press of the button triggers the Raspberry Pi to request the survey data from the server. After the data has been received, it gets displayed in the following fashion: The selected emotions get displayed individually after each other. Each emotion gets displayed as a „ripple“ which means as a light wave. The light has the matching color of the emotion from the survey and gets faded in and out of each ring in sequence from the middle to the edge. In between the fading, there is a short waiting period in which the light effect stays. The speed of this animation depends on the intensity of the emotion. We gave more intense emotions more weight by letting them stay longer and move slower. We placed the vibration motor in the inside of the device to match the position of the user's hands. They vibrate steady during the time the light stays. This way they are synced with the animation and a small emotions' vibration feels hectic, while a large one feels more stable.

Final Product Images

Concept Video

Function Video

Exhibition

We displayed the posters, showed the videos on the tavlet and used plants and a tablecloths to set up the environment in which the products will be used.