The AIBO robot database:
Download
1 / 10

The AIBO robot database: structured WoZ design and shallow annotation - PowerPoint PPT Presentation


  • 107 Views
  • Uploaded on

The AIBO robot database: structured WoZ design and shallow annotation. Anton Batliner Stefan Steidl, Christian Hacker, Elmar Nöth University of Erlangen. HUMAINE summer school, September 2004, Belfast. purpose.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' The AIBO robot database: structured WoZ design and shallow annotation' - unity-bonner


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

The AIBO robot database: structured WoZ design and shallow annotation

Anton Batliner

Stefan Steidl,

Christian Hacker,

Elmar Nöth

University of

Erlangen

HUMAINE summer school, September 2004, Belfast


Purpose
purpose

  • goal: database for automatic classification of emotional states (within PF-STAR)

  • addressing the ROE problem (reduction of effort) – if you want to deal with „natural“, representative emotions

    • sparse data: how to ensure that there are at least some emotions in your data?

    • reference: how to find/define/label the classes you want to classify?


Basic approach
basic approach

  • data driven

  • application oriented:

    • call center scenario

    • edutainment/entertainment

  • the Columbus approach: we take what we get * (not: we find what we are looking for)* (and we prefer to call it "emotional" user states)


Aspects addressed in the databases
aspects addressed in the databases

  • children's speech

  • emotional speech

  • human-robot communication

  • edutainment/entertainment

  • cross-linguistics (German-English)

  • read vs. spontaneous speech


Structured woz design
Structured WoZ design

  • no free interaction of WoZ* with user but sort of partiture script (fixed schema, recurrent phases) making inter- and intra-subject comparison possible

  • originally designed for call center scenario

  • pro's: interpretation **

  • con's: somehow less realistic; no emotional interaction between user and system (avatar) possible, i.e., sparse data

    * a human plays the role of the computer in a simulated human-computer interaction; after Baum, Lyman Frank : The Wonderful Wizard of Oz (1900). $

    **cf. Batliner et al. How to find trouble in communication. Speech Communication 2004.$ The Wizard of Oz

    with Judy Garland 1939:

………2. Somewhere over the rainbow

skies are blue,

and the dreams that you dare to dream

really do come true.


Shallow annotation
Shallow annotation

  • local vs. global

  • formal and functional

  • categorical vs. dimensional

  • first free labels, then catalogue of labels

  • laymen vs. experts

  • few (expert) vs. many (semi-naive) labellers

  • majority voting confusion matrix dimensions

  • granularity (raw  cover classes = more stability)

  • prototypicality (e.g. 0.6, 0.8, 1.0)

  • acoustic vs. linguistic marking

  • (classification) performance vs. interpretation


Map of the Parcours task numbers 1-6: crossings; A-D: AIBO behaves disobediently; Dance and Sit: tasks to fulfil; goals: cups 1-3 and GOAL

POSITION: START

AIBO addresses child : gesture ``Hi''

CHILD: tells AIBO what to do

+ co-operative: gets up

+ co-operative: goes forward

....

POSITION C, 4th crossing

- co-operative: stops

- co-operative: lays down

+ co-operative: stands up

- co-operative: lays down

+ co-operative: stands up

- co-operative: lays down

+ co-operative: stands up

+ co-operative: turns left

AIBO addresses child: turns head towards child

+ co-operative: goes forward

  • the child wants AIBO to react to his/her commands, in fact, AIBO follows its own script, i.e., the child reacts to AIBO's actions


Example position c no emotional behaviour
Example: position C, no emotional behaviour

Aibo geh geradeaus | stopp Aibo | stopp | dreh dich nach links | Aibo steh auf | dreh dich nach links | Aibo steh auf | dreh dich nach links | Aibo | steh auf | steh auf Aibo | und jetzt geh nach links | und jetzt geh geradeaus | Aibo *gen geradeaus |

conceptualization:

remote control tool


Example position c emotional behaviour
Example: position C, emotional behaviour

g'radeaus Aibolein ja M fein M gut M machst M du M *da M | *tz l"aufst du mal bitte nach links | stopp E Aibo stopp | nach links E umdrehen | nein M <*ne> nein M <*ne> nein M <*ne> so M weit M *simma M noch M nicht M aufstehen M Schlafm"utze M komm M hoch M | ja M so M ist M es M <*is> guter M Hund M lauf mal jetzt nach links | nach links Aibo | Aibolein M aufstehen M *son M sonst M werd' M ich M b"ose M hoch E | nach A links A | Aibo A nach A links A | Aibolein A ganz A b"oser A Hund A jetzt A stehst A du A auf A | hoch A | dreh dich ein bisschen | ja M so ist es <*is> gut stopp Aibo stopp | *tz lauf g'radeaus |

conceptualization:

pet dog


End of introduction
end of introduction

see you in the afternoon


ad