Decision making on robots using pomdps
This presentation is the property of its rightful owner.
Sponsored Links
1 / 12

Decision-making on Robots Using POMDPs PowerPoint PPT Presentation


  • 70 Views
  • Uploaded on
  • Presentation posted in: General

Christian Washington, Mohan Sridharan, Shiqi Zhang Computer Engineering, Louisiana State University Computer Science, Texas Tech University

Download Presentation

Decision-making on Robots Using POMDPs

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Decision making on robots using pomdps

Christian Washington, Mohan Sridharan, Shiqi Zhang

Computer Engineering, Louisiana State University

Computer Science, Texas Tech University

Disclaimer: This research is supported by NSF Grant No. CNS 1005212. Opinions, findings, conclusions, or recommendations expressed in this paper are those of the author(s) and do not necessarily reflect the views of NSF.

Decision-making on Robots Using POMDPs


Why robotics

Why Robotics?

  • Mobile robots have become a major part of today’s society

    • Military

    • Medicine

    • Search and Exploration

  • Many research problems

    • Autonomous control

    • Simultaneous Localization and Mapping(SLAM)

[4]


The problem

The Problem

  • Real world domains can present complex problems

    • Partial Observability

    • Non-deterministic action outcomes

    • Unforeseen changes

  • Sensors mounted on robots can provide a lot of data

    • How to process this data efficiently?


The solution

The Solution

  • Markov Decision Process

    • Given states, actions, transition probabilities, reward function

    • Want to maximize future expected reward (policy)

    • State of the system always known

  • Partially Observable Markov Decision Process(POMDP)

    • State of system is uncertain

    • Maintain a belief state: Probability Distribution over the state


Hierarchical pomdps

Hierarchical POMDPs

  • Hierarchy creates layers

  • High-level POMDP

    • Where to look

  • Intermediate-level POMDP

    • What to process

  • Low-level POMDP

    • How to process

[1]


Logical inference probabilistic planning

Logical Inference + Probabilistic Planning

  • Combine answer set programming and POMDPs

[2]


Research platform

Research Platform

  • Erratic Robot

    • Three wheeled

    • Hokuyo UTM-30LX laser range finder

    • Stereo camera

    • Sonar

    • On-board processor

    • Robot Operating System (ROS)

[4]


Summer objectives

Summer Objectives

  • Make target localization on robot more time efficient

  • Model uncertainty

    • In robot position using multiple hypothesis of target object location

    • In target location using hypothesis of own position


Research methods

Research Methods

  • Using POMDPs and Answer Set Programming

    • Revise algorithms

    • Change parameters

    • Run physical experiments on robot

      • Target localization

      • Path planning


Current status

Current Status

  • Running tests using BRIEF image recognition software

  • Solving smaller problems using POMDPs

  • Programming the robot to travel to a specified destination, then return to its original location


References

References

  • Shiqi Zhang and Mohan Sridharan. Active Visual Sensing and Collaboration on Mobile Robots using Hierarchical POMDPs. In the International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2012), Valencia, Spain, June 4-8, 2012.

  • Shiqi Zhang, Forrest Sheng Bao and Mohan Sridharan. (Student abstract) Combining Probabilistic Planning and Logic Programming on Mobile Robots. In the International Conference on Artificial Intelligence (AAAI 2012), Toronto, Canada, July 22-26, 2012.

  • Shiqi Zhang, Mohan Sridharan and Xiang Li. To Look or Not to Look: A Hierarchical Representation for Visual Planning on Mobile Robots. In the International Conference on Robotics and Automation (ICRA 2011), Shanghai, China, May 9-13, 2011.

  • http://www.cs.ttu.edu/~smohan/Research.html


Questions

QUESTIONS?


  • Login