Research Committee Meeting 25 th July 2019

1. Research Committee Meeting 25th July 2019

2. Committee Members • 3D Studio Blomberg • After Now • AMRC • Appearition • Apprentice • Arvizio • Atheer • Augumenta • Boeing • Bosch • Brainwaive • BSI • Contextere • CrossComm • DŵrCymru Welsh Water • Embry Riddle Univ • EPRI • ExxonMobil • EyeSucceed • FieldBit • Go Unlimited (UNLTD) • Georgia Tech • HART • Iristick • KognitivSpark • Lenovo • LogistiView • Marquette University • Medtronic • Mira Labs • Mozilla • MxD • Newport News Shipbuilding • NIST • Northrop Grumman • NVIDIA • Paracosma • PEREY Research & Consulting (chair) • Pison Technology • Proceedix • PTC • Qualcomm • RealWear • RE‘FELKT • Sarcos Robotics • ScopeAR • Talent Swarm • The MTC • ThirdEye • Theorem Solutions • UpSkill • Wunschsicht • VA Tech • ViewAR • Vuzix • XMReality

3. As participants in this meeting, we need to be mindful of the constraints of antitrust laws. • There shall be no discussions of agreements or concerted actions that may restrain competition. • This prohibition includes the exchange of information concerning pricing, rates, coverages, market practices or any other competitive aspect of an individual company’s operation. • Each participant is obligated to speak up immediately for the purpose of preventing any discussion falling outside these bounds. Antitrust Policy

4. Agenda

5. Growing this Committee

6. Growing this Committee • Is everyone (who needs to be) aware of this committee? • How to best perform outreach? • Visit Research Committee public web page http://thearea.org/research-committee-further-information/ or https://bit.ly/2qVnhXD

7. Introductions • Anyone new to our committee?

8. Human FactorsInterest Group

9. Chairs Qualcomm: Jonathan Kies Crosscomm: Don Shin Goal to create an AREA community dedicated to the exploration, discussion and research around AR-related human factors Please join the discord server https://discord.gg/HqcPFUf Next meeting is 12th September 2019 – 11 AM Eastern Human Factors Interest Group

10. Status Update No call in August • Topics that came out of the recent member survey • Measuring user performance & experience • AR User interface design (design principles & interaction paradigms) • Rapid prototyping tools and methods • Follow discussion on discord channel • Narrow down a set of useful goals and deliverables

11. Topics Updates • Develop a set of UX testing guidelines tailored for AR and HMDs • could include links to resources online • new set that we collaboratively develop • can cover multiple methods • usability testing, field testing, controlled experiments, etc • Develop a repository of existing (3rd party) design guidelines • links to guidelines • actual documents (if we are allowed to re-post) • informal guidelines and best practices from AREA members’ experience • Develop a list of prototyping tools and methods • including pros/cons

12. Short Term Steps • Use the time between now and Sept to • scope / define these deliverables • or modify toward what would be most useful to the group • Also discuss what would be the best format • Infographic? web page? • Updates and discussion via discord

13. AREA Research Projects Overview

14. Two Types of Research Projects • Member-Directed • Benefit solely for Sponsor Members who choose to fund or co-fund a research project • AREA-Directed • Benefit of AREA members (and, in the measure possible, the community at large)

15. Member-directed Projects • AREA members determine topic(s) and contribute fee to be invested in the project • AREA serves as research manager • Call for proposals • Coordinates and reviews responses • Contract is between research supplier and the AREA • All IP belongs to members

16. AREA-directed Projects (1 of 2) • All Sponsor, Contributor & Non-commercial/academic members may participate in idea submission • All the above classes of membership vote to choose the project topic • AREA member provides one research manager • Generates materials to be used in Call for Proposals • Coordinates and reviews CfP responses • Contract is between research supplier and the AREA • Members can be research suppliers

17. AREA-directed Projects (2 of 2) • Paid by the AREA Research Committee allocated budget : US$15,000/project • All results shared with all above classes of membership (members in good standing) • AREA owns all IP

18. Identification of and Strategies for Overcoming Barriers to AR Adoption in Manufacturing Environments • Deliverables • Comprehensive report • Framework tool (using Excel) • Case study • October 2018 to February 2019 4th AREA-directedResearch Project July

19. Update • Qualitative Interviews • Conducted • Analyzed • Questionnaire • Non-user survey launched and over 200 responses received • Very much need AR user in manufacturing participants • Case Study/white paper distributed at AREA Workshop • To identify additional survey participants • Offer the full version of the report as incentive xReality @Universität der Bundeswehr MünchenProf. Dr. Philipp A. Rauschnabel

20. Next Steps • Data Collection • AR user survey participants needed • Data Analysis • Based on data acquired by June • Prepare Report by end of July KATRIN TO UPDATE xReality @Universität der Bundeswehr MünchenProf. Dr. Philipp A. Rauschnabel

21. 5th Research Project Topic Best Practices when Merging IoT, AI and AR in the Workplace

22. Merging IoT, AI and AR • Connected workplaces produce copious real time data • Few people are qualified to discuss state of the art in all three of these fields (what is the state of the art?) • Not all “raw” data is appropriate for AR viewing • Not all users should get real time data • What are the best practices/recommendations to (begin to) sort this out?

23. Current Status • Case study finished • Final Report now being edited • Saverio is out of office until August 10

24. Next Steps • Review draft finals • Final deliverables to be prepared for distribution members • Formatting • Locked/secured for member distribution • Delivery ASAP

25. New/Future Directions for AR Research A research agenda is a framework for prioritizing obstacles that AREA members need addressed

26. Develop Research Recommendations Attributable to AREA Research Committee • Most urgent enterprise AR obstacles to be addressed in • Technology • Business • User experience/human factors • Interoperability/standards • Outreach/influence current and future research projects • Issue report quarterly or semi-annual • Promote directly to universities, government agencies • Post on AREA blog

27. Member ResearchPriorities Looking for shared research interests using low risk/high touch approach

28. Goals • Detect common research interests and identify potential joint projects • Determine if any (past) research • Could fill others’ gaps • Could be published by the AREA (“members only” or public) • Determine if literature reviews, meta analysis, etc. could be performed by one or more members

29. Preliminary Recommendations • Request Security, Safety committees and HFIG to contribute their top topics (completed in July) • Bring unpublished research to members in a repeatable, scalable manner • Articulate ‘Scalability’ into a “platform” • Round out findings with interviews to capture Provider segment perspectives (planned for September)

30. Security Committee Topics • Secure Identity and Authentication for multi-user wearable devices • Best practices for Secure AR display management • Layers of Data Rights and Permissions associated with individuals • Permissions for/in AR Cloud

31. Safety Committee Topics • Impacts of long term, repeated exposure to AR on vision acuity, vertigo, muscular-skeletal strain • Physiological transitional changes (using vs not using) • Cognitive loading and unloading (measures, impacts) • Use of gaze and eye tracking to measure (and how to manage) engagement, vigilance, cognitive load • How to ensure policies/procedures followed correctly?

32. Human Factors Topics • Measuring user performance and experience (cognitive load, engagement, etc) • AR User interface design (design principles and best practices) • Tools and methodologies for rapid AR prototyping • Methods for evaluating AR solutions (usability, heuristics)

33. Next Steps • Contact Provider segment members, schedule and conduct interviews • Define a repeatable AREA process for collecting, preparing and publishing previously unpublished research results

34. AREA Research Guest Speakers Invite researchers to share their current research projects with AREA members

35. Webinar Series • Purpose: expose AREA members to research happening in academic and corporate R&D centers • Target audiences: AREA members • Speakers: faculty and researchers from around the world • Logistics • Scheduling • Rehearsals

36. Your Feedback about these Webinars? • Should we continue? • Do you have nominations for speakers? • In parallel with committee meetings? • Public or Member-exclusive? • Has anyone gone to the archive to watch?

37. September Research Committee Webinar

38. October Research Committee Webinar

39. 6th AREA-directed Research Project Topic Selection Ballot

40. Categories for Project Topics • Software and hardware issues, such as: • Usability • Ergonomics • Technical performance • Content reuse • Market research issues, such as: • Comprehensive AR ecosystem assessment and mapping • Market sizes and geographic trends • Business process innovation issues, such as: • Best practices for AR design, purchase, implementation, and testing • End-user acceptance • Standards

41. July 18 Pitching Meeting • 18 attendees • 60 minutes • Six topics presented • Created the materials on this member portal page http://thearea.org/members/6th-area-member-research-project-proposal-ballot/

42. Ballot Page

43. Topics from Which to Select Prior to/on Aug 10 • AR and 5G for Enterprise • Web-based AR for the Enterprise • Size and Growth of Enterprise AR Market • Minimum Viable AR Glasses Requirements • AR Cloud in the Enterprise • Security Identity and Authentication Management for Shared Wearable AR Displays

44. Weighted Votes • One vote per member organization • Sponsor member = 4 points • Contributor member = 2 points • Any organization that has submitted a topic may also vote and this counts 1 point

45. Steps and Schedule

46. Measuring AR Impacts Interest Group • New AREA Activity

47. The Problems • Limited neutral and focused information available to measure the impact of Enterprise AR when • Building internal business cases (e.g ROI) for enterprise AR investment / justification • When AR solution providers are explaining benefits of AR to enterprise customers • Those seeking investment want to size opportunity

48. Opportunity • To develop (or improve existing) tools and use them to measure • Tangible and intangible, extrinsic and intrinsic costs and impacts, and return on investment (ROI) of deploying AR in specific enterprise settings and use cases • Current size and forecast growth of the enterprise AR market and its segments

49. Audiences/Stakeholders • Strategic planning professionals • Business analysts • Investors • Marketing professionals

50. Two of the AREA’s Four Strategic Goals • Support decision making by well-informed Enterprise AR Customers • Development of a Vibrant AR Tech Provider Ecosystem