1 / 33

Why 'Why' Matters for Multimedia Content Mathias Lux

Why 'Why' Matters for Multimedia Content Mathias Lux. Users in Context. Definition: Context.

leala
Download Presentation

Why 'Why' Matters for Multimedia Content Mathias Lux

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Why 'Why' Matters forMultimedia Content Mathias Lux

  2. Users in Context

  3. Definition: Context “Context is any information that can be used to characterize the situation of an entity. An entity is a person, place, or object that is considered relevant to the interaction between a user and an application, including the user and applications themselves.” Ref. G. Abowd et al., “Towards a better understanding of context and context-awareness. In Handheld and Ubiquitous Computing, vol. 1707 LNCS, 1999.

  4. Definition: Intention noun (1) thing intended; an aim or plan (2) Medicine the healing process of a wound (3) (intentions) Logic conceptions formed by directing the mind towards an object

  5. Context vs. Intention? Context is any information that can be used to characterize the situation of an entity. An entity is a person, […] noun • thing intended; an aim or plan […]

  6. A User’s Intention is • part of a user’s context • of manageable size (verb & frame) • related to the information need in search Examples • I want to download a new background for my mobile. • I want to share the first laugh of my daughter. • I want to see what a LanciaIntegrale looks like.

  7. User Intentions in the Web Underlying goals of web searches • Informational • to learn / know something • Navigational • to go to a specific place (on the web) • Transactional • to go somewhere to ultimately buy sth. Ref. Broder: A Taxonomy of Web Search. SIGIR Forum, 2002

  8. User Intentions in the Web Ref. Rose & Levinson: Understanding user goals in web search, WWW 2004

  9. User Intentions n Multimedia • Search • Production • Sharing • Archiving • Image • Video • Audio • Multiple modalities

  10. Hand-picked Examples Right now there is no all-in-one publication on user intentions in multimedia …

  11. User Intentions in Image Search old vs. new Starbucks logo my friend’s new car on flickr.com beautiful sunset for the background of my mobile Latest “explore” photos Ref. Lux, Kofler & Marques: A classification scheme for user intentions in image search, CHI 2010

  12. Do queries help with the search intention? User information need vs. query formulation in video search. • How to support users with video indexing and search methods? • Search goal failure is (partially) predictable • Based on keywords and • Based on natural language Ref. Kofler, Larson & Hanjalic: To Seek, Perchance to Fail: Expressions of User Needs in Internet Video Search, ECIR 2011

  13. Asking for the “Why?” behind the “What?” Learn to sing … Hear others singing … Ref. Hanjalic, Kofler & Larson: Intent and its Discontents: The User at the Wheel of the Online Video Search Engine, ACM MM 2012

  14. Online Survey: Why did you watch this video? • 270 participants • Online questionnaire • Why do you watch videos? • Category <-> reason? • -> Intention 2 category table Ref. Lagger, Lux & Marques: An Adaptive Video Retrieval System Based On Recent Studies On User Intentions While Watching Videos Online. ACM CIE, online.

  15. Helping with clever Uis? Ref. Lagger, Lux & Marques: An Adaptive Video Retrieval System Based On Recent Studies On User Intentions While Watching Videos Online. ACM CIE, online.

  16. Who are the Users in a Video Search System? • Study on users of • YouTube • BBC iPlayer • UitzendingGemist Ref. Kemman, Kleppe & Beunders: Who are the users of a video search system? Classifying a heterogeneous group with a profile matrix, WIAMIS 2012

  17. Who are the Users in a Video Search System? Ref. Kemman, Kleppe & Beunders: Who are the users of a video search system? Classifying a heterogeneous group with a profile matrix, WIAMIS 2012

  18. Why do People make Videos? • Study on four main goals: • Affection, Function, Sharing & Preservation. Ref. Lux & Huber: Why did you record this video? WIAMIS 2012

  19. Correlation of Clusters • ρ-Coefficient • Showing minimum, actual & maximum

  20. Implications? • 81% of the instances were assigned to more than one category. • Hypothesis: a discrete mapping to exactly one category is insufficient • “Preservation” and “Sharing” seem to be independent • Hypothesis: “Personal reflection” is not the opposite of “publishing” (cp. Kindberg) • „Preservation“ and „Function“ are neg. correlated • Hypothesis: Videos are not archived if they are taken for a functional reason.

  21. Intentional Framing Def. The framing of a picture is the Deutungsrahmen (interpretation frame of the image) which image producers have in mind during the creation moment of the picture.

  22. Intentional Framing

  23. Intentional Framing

  24. Intentional Framing and ..

  25. Examples for Intentional Framing

  26. Intentional Framing Assumption: Similar intentions for taking the pictures will lead to similar framings of the images. Hypothesis: Certain global image features can be used to differentiate framings. Ref. Riegler, Lux, Larson, … (2014?) How `how' reflects what's what: Content-based classification exploiting how users frame images (submitted)

  27. Connecting User Intentions & MMIS is a hard task ….

  28. Leveraging Educational Needs …

  29. Educational Needs • Surgeons need a “communication tool” • Portability & ease of use are critical • ? Streaming of videos and annotations ?

  30. Leveraging Self-Represention & Fun …

  31. Self-Representation • Streaming & sharing videos of games • to be hub or authority in a community • Twitch.tv, Everplay, Hitbox • Communication • One <-> Group

  32. Conclusion • Why “why” matters … • If we know what people want we can offer services that allow them to reach the goals faster or more efficient.

  33. Thanks for listening … • Mathias Lux • mlux@itec.uni-klu.ac.at

More Related