Housekeeping

1. Housekeeping • Seminar topics • Requirements • Sign up by Feb 3rd : https://www.surveymonkey.com/s/MXVQZV3 • Bonus 10% for those who do seminars the 1st day (Feb 12th) and 5% for those who do seminars the 2nd day (Feb 24th)

2. CSCI 4163/6610 W2015 Diary studies

3. Advertising Diary Activity • Did you remember to fill it out? • When did you do it? • As encountered? • In a batch? • Were the instructions clear? • What was easy/hard about it? • Do you think it captured your exposure to advertising?

4. Diary studies… • Participants collect data about events • As they happen • In the context of the event (in situ) • Can think of like a small, longitudinal questionnaire • Often used to prompt interview discussion (similar to observations in a contextual inquiry) • Can help understand rare/infrequent events

5. Data collection methods • Survey style forms • Paper (little training required, but hard to monitor) • Online entry forms • Google docs • Photographs, video • Digital/disposable camera, mobile phone • Audio recording • Voice recorder, mobile phone • Aggregating data online • Blogs (text, audio, video) , Twitter • Rich and timely information

6. Type of data recorded • When • Date/time • Duration • Activity/task • What • Activity/task • feelings/mood • Context (environment/setting)

7. When is data recorded? • Randomly • In response to prompts • At specific intervals • Based on activity

8. General types of diary studies • Unstructured • Ask participants to report on everyday activities • Trying to elicit general themes • Structured • Ask participants to report on everyday activities by answering specific questions about the activity • Combination of question types • Can also be used as a form of usability tests and problem reports • Ask them to complete a task and report results, identify bugs, etc.

9. Variations based on purpose Feedback (now) Elicitation (later) • Record everything in situ • No follow up • Focus on the “what” data • Mostly structured • Can be burdensome on participants and researchers • Record aspects or triggers of an activity • Follow up with an interview to gain more information • Data captured is used to elicit the “why” and the how” • Mostly unstructured • Can be problems with participant recall

10. Cultural Probe • Diary study++ • Used to not only record activities, but capture more of “felt life” • Stimulate thought as well as capture experiences • http://www.hcibook.com/e3/casestudy/cultural-probes/ - pack contained a small disposable camera and a listening glass that participants used to listen at walls and doors and write what they heard. It also contained a small solid state recorder packaged in a sleeve that said 'dream recorder'. • Was used by designers at the Royal College of Art, London, to study the way people see their own homes. The results were used to enable designers to get a 'feel' of the meaning of home for many people. • Experience sampling method (measure feelings, moods) • Technology Probes (prototypes, experimental artifacts)

11. Snow Day Cultural Probe • Who took part? Did you do all activities? Or a subset? What was easy/hard as a participant? • Preamble: • Pretend that I've delivered you a probe kit that includes a camera, a note pad, and a paper map of the city. I want to understand how stormy winter weather impacts student life and poses barriers. • Complete the following activities:

12. Cultural Probe activity 1. Take a pictures of your "storm info central" - how do you find out about impending/current weather conditions and cancellations? 2. Take pictures of weather impeding your normal daily activities - if you are out and about, use your map to record your path (is it your normal one?) - link pictures to locations if you can 3. Take pictures of how you cope with the weather (any work arounds? alternative activities?) 4. In your notepad, jot down 3 things you like about a stormy day and 3 things that you don't like 5. How could technology have helped you? (jot down or sketch out ideas of technologies that could help you out - don't worry about feasibility - dream big!)

13. Coordination Challenges • Keeping participants on track • Periodic reminders • Feedback about the level of detail in responses • Progressive incentives, surprise incentives/gifts (may or may not be allowable by BREB) • Adapting to changes • Start analysis as soon as first results arrive • May need to re-evaluate the diary format if the data being captured is not what you expected!

14. Advantages • Time efficient for researchers • Lower cost than direct observations • Can have a broad geographic distribution • Supports contextual reports over time • Natural environment • Can give rich data about contexts of use

15. Disadvantages • Participant fatigue • Missed responses (frequency data is generally unreliable – lower bound) • Study drop outs • “after the fact” reporting to catch up • Behaviour adjustment • Participants need reminders • Can be expensive for long durations • Volume of collected data can be overwhelming

16. Study protocol • Introductory letter • Consent form • Needs to motivate their participation • Very specific instructions • Can be helpful to give an example of a filled out form (take care not to prime/limit) • Diary form / collection aids

17. Forms of analysis • Track temporal patterns • Look for semantic patterns in visual data • Combine with interview analysis