Decision making on robots using pomdps
1 / 12

Decision-making on Robots Using POMDPs - PowerPoint PPT Presentation

  • Uploaded on

Christian Washington, Mohan Sridharan, Shiqi Zhang Computer Engineering, Louisiana State University Computer Science, Texas Tech University

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'Decision-making on Robots Using POMDPs' - amity

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Decision making on robots using pomdps

Christian Washington, Mohan Sridharan, Shiqi Zhang

Computer Engineering, Louisiana State University

Computer Science, Texas Tech University

Disclaimer: This research is supported by NSF Grant No. CNS 1005212. Opinions, findings, conclusions, or recommendations expressed in this paper are those of the author(s) and do not necessarily reflect the views of NSF.

Decision-making on Robots Using POMDPs

Why robotics
Why Robotics?

  • Mobile robots have become a major part of today’s society

    • Military

    • Medicine

    • Search and Exploration

  • Many research problems

    • Autonomous control

    • Simultaneous Localization and Mapping(SLAM)


The problem
The Problem

  • Real world domains can present complex problems

    • Partial Observability

    • Non-deterministic action outcomes

    • Unforeseen changes

  • Sensors mounted on robots can provide a lot of data

    • How to process this data efficiently?

The solution
The Solution

  • Markov Decision Process

    • Given states, actions, transition probabilities, reward function

    • Want to maximize future expected reward (policy)

    • State of the system always known

  • Partially Observable Markov Decision Process(POMDP)

    • State of system is uncertain

    • Maintain a belief state: Probability Distribution over the state

Hierarchical pomdps
Hierarchical POMDPs

  • Hierarchy creates layers

  • High-level POMDP

    • Where to look

  • Intermediate-level POMDP

    • What to process

  • Low-level POMDP

    • How to process


Logical inference probabilistic planning
Logical Inference + Probabilistic Planning

  • Combine answer set programming and POMDPs


Research platform
Research Platform

  • Erratic Robot

    • Three wheeled

    • Hokuyo UTM-30LX laser range finder

    • Stereo camera

    • Sonar

    • On-board processor

    • Robot Operating System (ROS)


Summer objectives
Summer Objectives

  • Make target localization on robot more time efficient

  • Model uncertainty

    • In robot position using multiple hypothesis of target object location

    • In target location using hypothesis of own position

Research methods
Research Methods

  • Using POMDPs and Answer Set Programming

    • Revise algorithms

    • Change parameters

    • Run physical experiments on robot

      • Target localization

      • Path planning

Current status
Current Status

  • Running tests using BRIEF image recognition software

  • Solving smaller problems using POMDPs

  • Programming the robot to travel to a specified destination, then return to its original location


  • Shiqi Zhang and Mohan Sridharan. Active Visual Sensing and Collaboration on Mobile Robots using Hierarchical POMDPs. In the International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2012), Valencia, Spain, June 4-8, 2012.

  • Shiqi Zhang, Forrest Sheng Bao and Mohan Sridharan. (Student abstract) Combining Probabilistic Planning and Logic Programming on Mobile Robots. In the International Conference on Artificial Intelligence (AAAI 2012), Toronto, Canada, July 22-26, 2012.

  • Shiqi Zhang, Mohan Sridharan and Xiang Li. To Look or Not to Look: A Hierarchical Representation for Visual Planning on Mobile Robots. In the International Conference on Robotics and Automation (ICRA 2011), Shanghai, China, May 9-13, 2011.