Takahiro Miyashita Dylan F. Glas Intelligent Robotics and Communication Laboratories

1. EU-Japan Workshop on R&D Cooperation in the field of Networked Technologies & Systems April 18, 2013 Japan-Europe TeleCare ServiceResearch and Development ProjectImproving elderly care with telerobotictechnologies and cloud-based knowledge systems Takahiro MiyashitaDylan F. Glas Intelligent Robotics and Communication Laboratories Social Media Research Laboratory Group Advanced Telecommunications Research Institute International (ATR)

2. Background: Mental Care for the Elderly • “Koekake” in Japanese: • Conversational techniques for • Supporting mental health • Exercising the memory • Delaying or preventing the onset of dementia • Recognized as important by care experts, but often neglected in practice…

3. Proposal Overview Develop remote conversation support technologyenabling teleworkers with caregiving expertise to provide mental care for elderly patients in care facilities using telepresence robots. Objectives: • Reducethe burden on caregivers • Supportcare recipients (e.g. interaction support, monitor to prevent wandering) • Createemployment opportunities for the elderly (tele-work)

4. Proposed Methodologies • Semi-autonomous robot technology- Enable care workers to teleoperate multiple robots • Care Expertise Database- Extract / model expertise from teleoperation logs ofconversations (“Big data” approach). • International collaboration- AAL technology leaders in Italy and the UK- Experimental care facility environment in Denmark- Multiple time zones -> effortless 24-hour telecare • PrototypeGlobal TeleCare System Care Expertise DB Teleworker Schedule Management Day Night

5. Telepresencerobots for Telework Significance to Industry • Telepresence robots are an active sector for startup companies, showing rapid growth。Ex.：InTouch Health growth rate: 252％used by over 3000doctors in over 400hospitals • Partnering with iRobot since July 2011。 Usable by experts who know the space • Challenging for amateurs • Cannot locate people • Difficult to follow etiquette (social rules) • New system - easy to use as video conferencing Telepresence robots developed at ATR Technology Development Specialists controlling a guide robot in Nara Conversationvia “Telenoid”

6. The state of care facilities today… Meals Mental care is important, but there is not enough time… Catering • Too few caregivers - cannot provide sufficient mental care • Most modern care robots are focused on physical care. Office Work Recreation therapy Bathing Exercise

7. Internet Future Vision: Care facilities utilizingtelepresence robots Telepresence robot services for recreational therapy • Communication support focusing on mental care, using telepresence robots→Ease the effects of the shortage of caregivers and reduce their workload→Create opportunities for elderly people to work and participate in society Care worker atremote location Telepresence robot servicesto monitor wandering These services will be enabled by the Global TeleCare System!

8. Global TeleCare Prototype System 1. Technologies for Situation Awareness in Conversational Interaction • Location / participant data • Extract data for conversation • Move to appropriate location • Determine appropriate conversational distance • Participate in conversation Elderly home Outpatient care facility 2. Technologies for Semi-Autonomous Conversational Interaction Inpatient care facility 昼 Accumulation and structuring of knowledgefrom caregivers in each country Translation (EU->JP) Translation (JP->EU) Other Language DB’s (EU) Japanese DB Global Care Expertise DB TranslationIntegration Multilinguistic Grid (NICT) Teleworker Schedule Management Japanese teleworker (experienced caregiver) European teleworker (experienced caregiver) 3. Global TeleCare System Construction Technology ・Translation via Multilinguistic Grid ・Japan-EU shared Care Expertise DB ・Schedule Management Day Night

9. Research Themes 2) Conversational Participation Technologies 1）Conversational Situation Awareness Technologies Technology developed previously Technology developed previously It’s convenient that it moves automatically Aggregation Window-shopping area It’s fun, like shopping with my grandchild. Structuring environmental information for pedestrian motion Wheelchair Shopping • Extension toMultiple participants &Conversation scenarios • Extension toAudio (Conversation) This Proposal This Proposal Addressee Addressee Speaker MicrophoneArray Mobile robots trackposition and conversation Structuring environmental information for conversation Received Best Paper Awards in human-robot interaction research:HRI’07, HRI’09, HRI’12(acceptance rate:HRI’07: 22%, ’09: 19%, ’12: 25%)

10. Research Themes 3）Global TeleCare System Integration Technologies Technology developed previously Tourist Information Headquarters, Nara City （Teleoperation ①） Ubiquitous Network Robot Platform (UNR-PF) Internet Teleoperation Interface（Personal Computer） Nara City Tourist Information Center （Tourist guidance） Inside ATR （Kyoto, Japan）（Teleoperation ②） Teleoperated Robot（Robovie-R3） Tourism, shopping, locomotion support: One person teleoperating 4 robots at once This Proposal • Extension to • Multilingual・Elderly Care

11. Merits of Japan-Europe Collaboration Complementaryfocus: • In Europe: technology focused on elderly peopleliving aloneor receiving in-home care. • In Japan: focus on group care facilities such as nursing homes. Sharingunique facilities: • Early adopters in Denmark have established an experimental elderly care center (CareLab). • Can conduct experiments in a real care environment • Not easily possible in Japan. Collaboration: DTI, ECHORD++, AALIANCE2, etc. • Coordination between projects • Effective support of care givers / receivers in home / group care facilities • Import technology to European society Proposed Collaborators • Denmark • Dr. Troels Oliver Vilms Pedersen, Dr. Claus Risager （DTI） • Patient@home • Italy • Prof. Paolo Dario, Dr. Filippo Cavallo （SSSA） • ECHORD++　／　AALIANCE2　／　RobotEra　／　RoboLaw • United Kingdom • Prof. Rossi Setchi, Dr. Renxi Qiu（Cardiff Univ. ） • SRS

12. Coordination between organizations • MOU's already signed with DTI, SSSA - cooperative research is beginning. • DTI: Collaborative research has begun with P@H • SSSA: Cooperation since 2008. In this case agreed to collaborate. Currently planning a collaborative workshop for Autumn 2013. • EU-JAPAN ForumAgeing Societies in Europe and Japan: Policy Responses and Research & Innovation Solutions for Active and Healthy Ageing (Oct. 9-10, 2012)Agreed to coordination between all organizations.

13. Expanding on Research Results Enhancing creative innovation / international competition • Development of specific service models for care-focused telework through robot teleoperation • Variation between cultures • Different service tasks International standardization 　・UNR Platform (infrastructure supporting TeleCare system): standardization completed: ITU-T SG16 Q25 IoT. 　・Proposed standard methodologies for telepresence robots: ITU-T SG16 Q5 Telepresence systems.

14. Application of Research Results • Use in Society • Creation of service models through Japan-EU collaboration, extending beyond elderly care • Active seniors able to perform telework in their respective fields • Personnel training • Development of education courses for nursing with telepresence robots, training of service providers

15. Conclusion In pursuit of these three objectives: • Reducing workload of care workers • Supporting care receivers (conversation support, monitoring of wandering) • Supporting employment for elderly people We propose to implement a “Global TeleCarePrototype System" enabling effortless 24-hour telecare through Japan-Europe collaboration enabled by the development ofa Japan-Europe care expertise databaseand new teleoperation support technologiesfor telepresence robots. Thank you for your attention.

16. Further References

17. Patient@Home • Title: Patient-at-home: Innovative Welfare Technology for the 21st Century • Telework government fund（SPIR） • Principal Agency: Southern Denmark University, DTI • Period: 2012.2 – 2018.1 • Summary: Develop new social welfare technology and services for use at home by elderly people living alone, helping increase patients’ motivation with respect to their own healthcare and assemble areliable framework for health care data collection. • Merits of collaboration: By using P@H, it is possible to conduct experiments and develop service models, which would be difficult given the current situation in the field of elderly care within Japan.

18. ECHORD++ • Title: European Clearing House for Open Robotics Development Plus Plus • FP7-ICT • Representative Organization: TUM (Prof. Alois Knoll) • Period: 2013.10 – 2018.9 • Overview: European collaborative robotics researchis set up to collaborate directly with SMB’s and startups. Creating experimental environments in which it is possible to easily test research results related to robotsand before-marketproducts with end-users. • Merit of collaboration： Provides an experimental environment usable for integrated technology development with other European FP7projects outside of Denmark, and enables the survey of real user needs.

19. AALIANCE2 • Title：　The Next Generation European Ambient Assisted Living Innovation Alliance • FP7-ICT • Primary Institution： SSSA(Principal members：6other institutions) • Period：　2011.10 – 2013.9 • Overview：　AALIANCE2is an Ambient Assisted Living initiative（assisted living technologies incorporating environmental sensorsand robots) utilizing leading-edge ICT to support health maintenance for the elderly, survey technology trends in the US and Asia, and support collaboration.Created a roadmap for AAL in Europe covering the next 10 years. • Merit of Collaboration: Through technology exchange and discussion with Europe’s AAL-related industryand researchorganizations, we can develop an AALroadmap for the EU and simplify standardization activities and collaboration with individual countries in the EU.

20. RobotEra • Title：　Implementation and integration of advanced Robotic systems and intelligent Environments in real scenarios for the ageing population • FP7-ICT • Representative Organization：　SSSA • Period：　2012.1 – 2015.12 • Overview：An initiative aimed at actual deployment of advanced robot services in society: development, implementation, and demonstration of services related to effectiveelderly careand supporting independence, evaluating scientificand technological effectiveness、and using surveys to investigate acceptance of these technologies in society. • Merit of collaboration： to advance the development of technology for home care and independence support for the elderly, this proposal combined with our technology will cover everything from independent living to group care facilities, and efficient development of tele-care support technologies.

21. RobotLaw • Title：　Regulating Emerging Robotic Technologies in Europe: Robotics facing Law and Ethics • FP7-ICT • Representative agency：　SSSA • Period：　2012.3 – 2014.2 • Overview： To conduct surveys and discussion of ethical issues and necessary legislation regarding the introduction of robotic and bio-robiotic technology into society, particularly focusing on robots that interact with people, and to consolidate the results into a proposal to the EC.

22. SRS • Title：　Multi-Role Shadow Robotic System for Independent Living • FP7-ICT • Representative agency：　Cardiff Univ. • Period：　2010.2 – 2013.1 • Overview: The objective of this projectis the development of prototype teleoperation and semi-autonomous robot solutions to support home care for elderly people living alone。 Surveying customer needs and implementing systems to address them.