slide1
Download
Skip this Video
Download Presentation
The AIBO robot database: structured WoZ design and shallow annotation

Loading in 2 Seconds...

play fullscreen
1 / 10

The AIBO robot database: structured WoZ design and shallow annotation - PowerPoint PPT Presentation


  • 107 Views
  • Uploaded on

The AIBO robot database: structured WoZ design and shallow annotation. Anton Batliner Stefan Steidl, Christian Hacker, Elmar Nöth University of Erlangen. HUMAINE summer school, September 2004, Belfast. purpose.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' The AIBO robot database: structured WoZ design and shallow annotation' - unity-bonner


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

The AIBO robot database: structured WoZ design and shallow annotation

Anton Batliner

Stefan Steidl,

Christian Hacker,

Elmar Nöth

University of

Erlangen

HUMAINE summer school, September 2004, Belfast

purpose
purpose
  • goal: database for automatic classification of emotional states (within PF-STAR)
  • addressing the ROE problem (reduction of effort) – if you want to deal with „natural“, representative emotions
    • sparse data: how to ensure that there are at least some emotions in your data?
    • reference: how to find/define/label the classes you want to classify?
basic approach
basic approach
  • data driven
  • application oriented:
    • call center scenario
    • edutainment/entertainment
  • the Columbus approach: we take what we get * (not: we find what we are looking for)* (and we prefer to call it "emotional" user states)
aspects addressed in the databases
aspects addressed in the databases
  • children\'s speech
  • emotional speech
  • human-robot communication
  • edutainment/entertainment
  • cross-linguistics (German-English)
  • read vs. spontaneous speech
structured woz design
Structured WoZ design
  • no free interaction of WoZ* with user but sort of partiture script (fixed schema, recurrent phases) making inter- and intra-subject comparison possible
  • originally designed for call center scenario
  • pro\'s: interpretation **
  • con\'s: somehow less realistic; no emotional interaction between user and system (avatar) possible, i.e., sparse data

* a human plays the role of the computer in a simulated human-computer interaction; after Baum, Lyman Frank : The Wonderful Wizard of Oz (1900). $

**cf. Batliner et al. How to find trouble in communication. Speech Communication 2004.$ The Wizard of Oz

with Judy Garland 1939:

………2. Somewhere over the rainbow

skies are blue,

and the dreams that you dare to dream

really do come true.

shallow annotation
Shallow annotation
  • local vs. global
  • formal and functional
  • categorical vs. dimensional
  • first free labels, then catalogue of labels
  • laymen vs. experts
  • few (expert) vs. many (semi-naive) labellers
  • majority voting confusion matrix dimensions
  • granularity (raw  cover classes = more stability)
  • prototypicality (e.g. 0.6, 0.8, 1.0)
  • acoustic vs. linguistic marking
  • (classification) performance vs. interpretation
slide7

Map of the Parcours task numbers 1-6: crossings; A-D: AIBO behaves disobediently; Dance and Sit: tasks to fulfil; goals: cups 1-3 and GOAL

POSITION: START

AIBO addresses child : gesture ``Hi\'\'

CHILD: tells AIBO what to do

+ co-operative: gets up

+ co-operative: goes forward

....

POSITION C, 4th crossing

- co-operative: stops

- co-operative: lays down

+ co-operative: stands up

- co-operative: lays down

+ co-operative: stands up

- co-operative: lays down

+ co-operative: stands up

+ co-operative: turns left

AIBO addresses child: turns head towards child

+ co-operative: goes forward

  • the child wants AIBO to react to his/her commands, in fact, AIBO follows its own script, i.e., the child reacts to AIBO\'s actions
example position c no emotional behaviour
Example: position C, no emotional behaviour

Aibo geh geradeaus | stopp Aibo | stopp | dreh dich nach links | Aibo steh auf | dreh dich nach links | Aibo steh auf | dreh dich nach links | Aibo | steh auf | steh auf Aibo | und jetzt geh nach links | und jetzt geh geradeaus | Aibo *gen geradeaus |

conceptualization:

remote control tool

example position c emotional behaviour
Example: position C, emotional behaviour

g\'radeaus Aibolein ja M fein M gut M machst M du M *da M | *tz l"aufst du mal bitte nach links | stopp E Aibo stopp | nach links E umdrehen | nein M <*ne> nein M <*ne> nein M <*ne> so M weit M *simma M noch M nicht M aufstehen M Schlafm"utze M komm M hoch M | ja M so M ist M es M <*is> guter M Hund M lauf mal jetzt nach links | nach links Aibo | Aibolein M aufstehen M *son M sonst M werd\' M ich M b"ose M hoch E | nach A links A | Aibo A nach A links A | Aibolein A ganz A b"oser A Hund A jetzt A stehst A du A auf A | hoch A | dreh dich ein bisschen | ja M so ist es <*is> gut stopp Aibo stopp | *tz lauf g\'radeaus |

conceptualization:

pet dog

end of introduction
end of introduction

see you in the afternoon

ad