1 / 47

Scaling Human Robot Teams

Scaling Human Robot Teams. Prasanna Velagapudi Paul Scerri Katia Sycara Mike Lewis Robotics Institute Carnegie Mellon University Pittsburgh, PA. Large Multiagent Teams. 1000s of robots, agents, and people Must collaborate to complete complex tasks. Search and Rescue. Disaster

makaio
Download Presentation

Scaling Human Robot Teams

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Scaling Human Robot Teams Prasanna Velagapudi Paul Scerri Katia Sycara Mike Lewis Robotics Institute Carnegie Mellon University Pittsburgh, PA

  2. Large Multiagent Teams 1000s of robots, agents, and people Must collaborate to complete complex tasks Search and Rescue Disaster Response UAV Surveillance

  3. Large Multiagent Teams

  4. Large Multiagent Teams • Network Constraints

  5. Large Multiagent Teams • Human Information Needs

  6. Network Constraints • Networks affect human interface design • Limited bandwidth • Significant latency • Lossy transmission • Partial/transient connectivity

  7. Network Constraints • How can we design robust tasks? • Feasible under network constraints • Tolerant of latency • Within bandwidth constraints • Robust to changes in information

  8. Network Constraints • Humans are a limited resource

  9. Network Constraints • Humans are a limited resource • Centralized, expensive • Limited attention and workload • Penalties for context switching • Necessary for certain tasks • Complex visual perception • Meta-knowledge

  10. Network Constraints • How do we maximize the effectiveness of humans in these systems with respect to network constraints?

  11. MrCSMulti-robot Control System

  12. MrCSMulti-robot Control System Status Window Map Overview Video/ Image Viewer Waypoint Navigation Teleoperation

  13. [Velagapudi et al, IROS ’08] Victims Found in USAR Task Number of Victims

  14. [Velagapudi et al, IROS ’08] Task decomposition

  15. Network Constraints • How we divide tasks between agents may affect performance • What is the best way to factor tasks? • Where should we focus autonomy?

  16. Large Multiagent Teams • Human Information Needs

  17. Human Information Needs • Human operators need information to make good decisions • In small teams, send everyone everything • This doesn’t work in large systems

  18. Human Information Needs • Sensor raw datarates • Proprioception • < 1kbps • RADAR/LIDAR • 100kbps – 20Mbps • Video • 300kbps – 80Mbps

  19. Human Information Needs • Can’t transmit every bit of information • Selectively forward data • How do agents decide which pieces of information are important? • Fuse the data • What information are we losing when we fuse data?

  20. Asynchronous Imagery • Inspired by planetary robotic solutions • Limited bandwidth • High latency • Multiple photographs from single location • Maximizes coverage • Can be mapped to virtual pan-tilt-zoom camera

  21. Streaming Mode Panorama Mode Panoramas stored for later viewing Streaming live video [Velagapudi et al, ACHI ’08] Asynchronous Imagery

  22. Panorama 6 Streaming 5 4 Average # of victims found 3 2 1 0 Within 0.75m Within 1m Within 1.5m Within 2m Accuracy Threshold [Velagapudi et al, ACHI ’08] Victims Found

  23. Environmental Factors • Colocated operators get extra information • Exocentric view of other agents • Ecological cues • Positional and scale cues

  24. Conclusion • Need to consider the practicalities of large network systems when designing for humans. • Need to consider human needs when designing algorithms for large network systems.

  25. Our Work

  26. Cognitive modeling • ACT-R models of user data • Determine • What pieces of information users are using? • Where are the bottlenecks of the system?

  27. Environmental Factors • Colocated operators get extra information • Exocentric view of other agents • Ecological cues • Positional and scale cues

  28. Utility-based information sharing • It is hard to describe user information needs • Agents often don’t know how useful information will be • Many effective algorithms use information gain or probabilistic mass • Can we compute utility for information used by people

  29. MrCSMulti-robot Control System

  30. MrCSMulti-robot Control System Status Window Map Overview Video/ Image Viewer Waypoint Navigation Teleoperation

  31. Victims Found Number of Victims

  32. Task decomposition Search Navigation

  33. Task decomposition

  34. Asynchronous Data • One way to address the latency of networks is to transition to asynchronous methods of perception and control. • Asynchronous imagery • Decouples users from time constraints in control

  35. Asynchronous Imagery • Inspired by planetary robotic solutions • Limited bandwidth • High latency • Multiple photographs from single location • Maximizes coverage • Can be mapped to virtual pan-tilt-zoom camera

  36. Streaming Mode Panorama Mode Panoramas stored for later viewing Streaming live video Asynchronous Imagery

  37. Panorama 6 Streaming 5 4 3 2 1 0 Within 0.75m Within 1m Within 1.5m Within 2m Accuracy Threshold Victims Found Average # of victims found

  38. Tools • USARSim/MrCS • VBS2 • Procerus UAVs • LANdroids • ACT-R

  39. USARSim • Based on UnrealEngine2 • High-fidelity physics • Realistic rendering • Camera • Laser scanner (LIDAR) [http://www.sourceforge.net/projects/usarsim]

  40. MrCSMulti-robot Control System

  41. MrCSMulti-robot Control System Status Window Map Overview Video/ Image Viewer Waypoint Navigation Teleoperation

  42. VBS2 • Based on Armed Assault and Operation Flashpoint • Large scale agent simulation • “Realistic” rendering • Cameras • Unit movements [http://www.vbs2.com]

  43. Procerus UAVs • Unicorn UAV • Developed at BYU • Foam EPP flying wing • Fixed and gimbaled cameras • Integrated with Machinetta agent middleware for full autonomy

  44. LANdroids Prototype • Based on iRobot Create platform • Integrated 5GHz 802.11a based MANET • Designed for warfighter networking • Video capable

  45. ACT-R • Cognitive modeling framework • Able to create generative models for testing

More Related