Tasks abilities and term projects
Sponsored Links
This presentation is the property of its rightful owner.
1 / 18

Tasks, Abilities, and Term Projects PowerPoint PPT Presentation

  • Uploaded on
  • Presentation posted in: General

Tasks, Abilities, and Term Projects. Paul Cohen. But first...Names!. Emily Oliver Curious George ... Come on, people! . What we want. Define a handful of tasks, each of which requires multiple abilities. Each ability is used for more than one task

Download Presentation

Tasks, Abilities, and Term Projects

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Tasks, Abilities, and Term Projects

Paul Cohen

But first...Names!

  • Emily

  • Oliver

  • Curious George

  • ...

  • Come on, people!

What we want

Define a handful of tasks, each of which requires multiple abilities.

Each ability is used for more than one task

Each task requires more that one ability

The outputs of some abilities are the inputs of others

Each team works on one ability (or a small number) but exercises it in all tasks


  • Meet and Greet

  • Turntaking games

  • Tidying up

  • Whazzat (Wubble World)

Meet and Greet

  • Amr Gaber’s idea:

    • Robot sits somewhere public, greets people, learns to recognize them and their names, learns to recognize moods and attitudes, learns social conventions re chatting...

  • Examples

    • What to say to someone you do/don’t recognize

    • What to say when two people are talking to each other

    • What to say when people are hanging around/walking fast

      “Hi Paul, nice to see you again. How’s Carole? I remember you were in the lab last thursday with Cody. He is here a lot. Sometimes I think he sleeps here. ...”

      “Hi Ian, I see you are talking with someone and don’t want to interrupt, but could you introduce me to your friend?”

Meet and Greet Abilities

Turntaking Games

Peekaboo !

Pattycake !

Turntaking Games Abilities

Clean Up

Clean Up Abilities

Go to the red cone

Wubble World

Work with Daniel Hewlett and Wesley Kerr

Wubble and room design by Teresa Dey

How Wubbles Learn the Meanings of Words

"Go to the blue cylinder"

1. parse



the blue cylinder

3. score correspondences between retrieved representation and scene

2. retrieve a semantic representation of a word or phrase

5. given positive feedback, update semantic representation

4. act or ask

Wubble Abilities

Other Abilities

Assignment for Next Week

  • Break into groups for the four tasks (we’ll organize around abilities later)

  • Storyboard a few minutes in the life of the robot doing the task

  • Make a refined list of abilities

  • Search for off-the-shelf software for these abilities in ROS and online. Example 1, Example 2, Example 3, Example 4,

  • Pay attention to glue: concepts and control

  • Write and present a 15-minute dissertation on all of the above

  • Login