Multi-Criteria News Selection Strategies: An Experiment by Judith Masthoff

1. Selecting news to suit a group of criteria: an exploration Judith Masthoff University of Brighton

2. Average Strategy Use average of the individual ratings Group list: (E, F) H (D, J) A I B G C

3. Least Misery Strategy Use minimum of the individual ratings Group list: F E (H, J, D) G B I C A

4. Average Without Misery Strategy Use average of the individual ratings, excluding items below threshold (say 4) Group list: (E, F) H (D, J) B G

5. Experiment: How people do it • 36 subjects • Given ratings of news items on three criteria • Which to watch if only time for 1 item, 2 items, …, 7 items

6. Criteria used • Importance of the news in general • Relevance of the location to you • Recency of the news

7. Criteria used • Importance of the news in general • Relevance of the location to you • Recency of the news

8. Results - Part 1

9. Results - Part 1 Red = Average Strategy

10. Results - Part 1 Red = Average Strategy Shaded =Least Misery Strategy

11. Results - Part 2

12. Results - Part 2 Red = Average Strategy

13. Results - Part 2 Red = Average Strategy Red dotted = Average Without Misery Strategy

14. Results - Part 3

15. Introduction of A and I A (10, 1, 10) I (10, 3, 7) Grey = This experiment Black = Old experiment

16. Dealing with inequality

17. Average Strategy Use average of the individual ratings Group list: (E, F) H (D, J) A I B G C

18. Average over Important Criteria Use average of the individual ratings Group list: A E (F, I) (H, J) D G B C

19. Least Misery Strategy Use minimum of the individual ratings Group list: F E (H, J, D) G B I C A

20. Least Misery For Important Criteria Use minimum of the individual ratings Group list: A F E I (H, J, D) G B C

21. Average Strategy Use average of the individual ratings Group list: (E, F) H (D, J) A I B G C

22. Average Strategy with Weights Use average of the individual ratings Group list: E A F I H J D G B C (3-1-3) E F A (H,I) J D G B C (2-1-2)

23. Average Without Misery Strategy Use average of the individual ratings, excluding items below threshold (say 6) Group list: (E, F) H (D, J)

24. Average Without Misery for Some Use average of the individual ratings, excluding items below threshold (say 6) Group list: (E, F) H (D, J) A I (threshold 6) (E, F) A I (threshold 7)

25. Results - Part 1 Red = Average Strategy Shaded =Least Misery Strategy

26. Results - Part 1 Red = Average Strategy Shaded =Least Misery Strategy Blue dotted = Average Without Miseryfor Some

27. Results - Part 2 Red = Average Strategy Dotted = Average Without Misery

28. Results - Part 2 Red = Average Strategy Blue = Average With Weights Dotted = Average Without Misery (blue: for Some)

29. Results - Part 3

30. Results - Part 3 Yellow shading = Least Misery for Important Criteria

31. Conclusions • Similarity between multiple criteria and multiple people • Main issue is inequality in importance • Adapted strategies help to explain a bit • But more work needed