Prototype evaluation and results

We tested our 2nd MVP with one on-site user test followed by interview and three interviews based on video prototype. The test plan and interview frame is as appendix.

Based on these user tests, we got following results considering our UX goals and also user interface / interaction which was our main distinguishing factor.


Results considering UX Goals:

Intuitive

• Overall, the design was considered intuitive, because user needed just to wear the cloth. Other things happened automatically based on the movements.
• Hardening material was considered intuitive feedback system for guiding towards correct posture, although it was mentioned that unless knowing that feature, it might confuse user at the beginning.
• Not necessarily intuitive: vibration notifications: It is important to design how would they work and when they are given.

Hassle free - Does not distract the normal flow of the work and does not add any extra steps while using it. The point is to make work of the user free from extra identifications and setups.

• Considered mostly non-distractive for workflow. Only added step is wearing the shirt, which in some cases might be a downside. Mostly considered removing more extra steps than adding them.
• Risks for this:
• distracting/annoying notifications ( –>possibility to switch off notifications is a must)

Comfortable

• Breathable, lightweight, as unnoticeable as possible, soft.
• Male and female fits.
• Sound or vibration alerts can be uncomfortable for some users. – Possibility to switch those off.

Takes different fashions and styles into account

• Models for male and female. 
• Takes company policies and dress codes into account. 
• Possibility to choose to wear over other clothes or under them.

Results considering feedback modalities, interaction and interface:

Feedback about guidance towards correct posture by self hardening materials was considered useful, usable, helpful and intuitive. It gives more information easier about how the posture should be corrected than other modalities.
Sound and vibration notifications divided opinions for and against. There should be a possibility to switch off notifications.
The vibration should also be designed so, that user can recognize meanings from it. For example: 1. Vibration notification when bad posture has been on too long (e.g. 30 seconds). 2. Self-hardening material guides the user towards correct posture. 3. When the correct posture is found, system notifies about that with different kind of vibration, e.g. two short vibrations and the self-hardening material guiding loosens its touch.

The possibility of flexible screen in the cloth itself, even if it would not reduce the qualities of the cloth or fabric, were not considered very important. Most of the participants thought they would like to have the screen, as much it is needed, in some other device like phone or computer.


Affects to the design:

What there is to keep?:

• Main idea and functionalities:
• recognizes user
• helps things in smart office recognize user: authentication and other recognizing
• opens locks
• automatic ergonomical adjusting
• posture notification and guidance

• Self-hardening material was considered intuitive –> focus on that.
• In addition vibration and sound notifications, which can be switched off.
• Minimized screen use.
• App connection for settings and configurations.

Appendix 1: Test plan (partly in Finnish) and interview frame

Roolijako

Moderaattori 1: Ohjaa koko testiä ja osallistujaa skriptin mukaan (tekee havaintoja ja muistiinpanoja mikäli ehtii)

Moderaattori 2: säätää pöytää, tekee havaintoja ja muistiinpanoja

Moderaattori 3: säätää valoja, tekee havaintoja ja muistiinpanoja

Test script:

• Before test:
• Written consent
• Brief the participant: describe concept briefly, show storyboard? This test is to test the use of the concept and the physical elements and also show participant the scenario
• Participant is briefed, that the test is demonstrating a work day.
• Test starts outside the “office”
• Participant is asked to wear a vest, T-shirt or a hoodie which represents the product.
• Participant can choose from different options: a vest (Jouko brings), T-shirt (Jouko brings one, other sizes?) or a hoodie (Jouko brings one, other sizes?)
• 
  
• When the shirt is on, test moderator shows the first screen of the prototype (Hello!)
• Doors are opened for the participant
• Table is adjusted for the participant. (Table height just below elbow height)
• Adjustments screen is showed for the participants.
• Moderator follows the actions of the participant on the screen and acts by those.
• Participant is asked to sit down OR “work” by standing
• Let’s assume that participant has worked for some time and that participant’s posture is going bad:
• Tell this scenario to the participant and show the posture correction screen.
• Tell the participant, that simultaneously the shirt gives haptic notification (e.g. vibration or EMS) AND haptic feedback by hardening material that guides towards good posture.
• 
  
• 
  

Interview frame:

• What do you think about this kind of concept?

• Would you use it, if you would have a chance? Why?/Why not?
• How useful do you think this is?
• What would make it better?

• What kind of affect on your normal workday (or the flow of work) do you think using this would have?
• 
  
• By what reasons did you choose which cloth to wear?

• What kind of preferences you have for the cloth itself?
• What kind of cloth would be the most comfortable for you?

• Where would you prefer the screen to be?
• Feedback system
• What kind of feedback system you would prefer?
• What do you think of following feedback modalities in this system:
• vibration
• EMS
• How would you describe the intuitivity if this concept?
• Haastattelussa kysytään myös muista mahdollisista ominaisuuksista:
• Muista juoda vettä
• Muista lepuuttaa silmiä
• Ääniohjaus
• Näyttö materiaalissa