comris cohabited mixed reality information space n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
COMRIS -- Cohabited Mixed-Reality Information Space PowerPoint Presentation
Download Presentation
COMRIS -- Cohabited Mixed-Reality Information Space

Loading in 2 Seconds...

play fullscreen
1 / 31

COMRIS -- Cohabited Mixed-Reality Information Space - PowerPoint PPT Presentation


  • 83 Views
  • Uploaded on

COMRIS -- Cohabited Mixed-Reality Information Space. An ‘en route’ snapshot The COMRIS Consortium. A one-liner – or two. COMRIS develops wearable technology to focus the attention of participants in large scale events.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'COMRIS -- Cohabited Mixed-Reality Information Space' - bowen


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
comris cohabited mixed reality information space

COMRIS -- Cohabited Mixed-Reality Information Space

An ‘en route’ snapshot

The COMRIS Consortium

COMRIS Soft Poster Presentation

a one liner or two
A one-liner – or two

COMRIS develops wearable technology to focus the attention of participants in large scale events.

COMRIS is about understanding and enabling the social engine of complex societies.

COMRIS Soft Poster Presentation

the comris vision
The COMRIS Vision
  • Co-Habited Mixed Reality
  • The social engine and scaling
  • From parrot to component-wear
  • Context sensitive text and speech
  • Self-Evaluation of a wearable assistant
  • CAVE interaction
  • COMRIS and social science

COMRIS Soft Poster Presentation

the conference center
The Conference Center

COMRIS Soft Poster Presentation

welcome to rave 2000
Welcome to RAVE 2000

COMRIS Soft Poster Presentation

rave 2000 a test bed
RAVE 2000: a test bed
  • RAVE 2000 is an artificially designed conference
  • RAVE 2000 creates situations in which scenes of various encounters can be played by agents competing for attention
  • RAVE 2000 is the test bed for our ideas and for the technology

COMRIS Soft Poster Presentation

comris scenarios
COMRIS Scenarios

Attend to more interests

See the interesting things

Meet the right people

Get more done

Grab a taxi in time

Share dinner with an interesting person

COMRIS Soft Poster Presentation

the comris vision1
The COMRIS Vision
  • Co-Habited Mixed Reality
  • The social engine and scaling
  • From parrot to component-wear
  • Context sensitive text and speech
  • Self-Evaluation of a wearable assistant
  • CAVE interaction
  • COMRIS and social science

COMRIS Soft Poster Presentation

slide9

Appearance based

exploration

Selective presentations

of role and skills

Community of Agents

that know each other and

who share an interest

Evaluating the

competitors

Competence

Competing

for attention

Relevance

Attention Attention

important message from

the winner

Scalability - Conceptual

Large groups

of individuals

COMRIS Soft Poster Presentation

comris agent model

Competence

Relevance

Agent

Context

interest

Appearance

Presentation

COMRIS Agent Model

COMRIS Soft Poster Presentation

slide11

You have an Idea and want to promote it

——o——

You must find and talk to the right person

——o——

An idea can be discussed in a group

——o——

Sometimes it is best to just shout

COMRIS Soft Poster Presentation

the comris vision2
The COMRIS Vision
  • Co-Habited Mixed Reality
  • The social engine and scaling
  • From parrot to component-wear
  • Context sensitive text and speech
  • Self-Evaluation of a wearable assistant
  • CAVE interaction
  • COMRIS and social science

COMRIS Soft Poster Presentation

comris parrot design
COMRIS Parrot Design

COMRIS Soft Poster Presentation

parrot usability studies
Parrot Usability Studies
  • User Control: do users want to be in control of message delivery or do they want automatic delivery?
  • The parrot has five buttons but the user needs several functions to interact with it. What is the preferred design?

And now with the real thing!

COMRIS Soft Poster Presentation

the comris vision3
The COMRIS Vision
  • Co-Habited Mixed Reality
  • The social engine and scaling
  • From parrot to component-wear
  • Context sensitive text and speech
  • Self-Evaluation of a wearable assistant
  • CAVE interaction
  • COMRIS and social science

COMRIS Soft Poster Presentation

parrot speaking
Parrot speaking...

“A presentation on numerical learning methods, a topic you are definitely interested in, is starting in 5 minutes in room B. You may want to catch the speaker afterwards since he is a reviewer for your I3 project. Maybe you want to say hi to your friend Sandy who is near you. Don’t forget to mention the present that she gave to you last timeyou met”

COMRIS Soft Poster Presentation

slide19

The parrot is a wearable device providing assistance to the user

in an information rich environment. Its software counterpart, the PA (Personal Assistant) realizes the loose coupling between the virtual world inhabited by a community of software agents (PRA Personal Representative Agent) and the physical world, inhabited by human agents - users.

virtual space

physical space

PRA

PA

information push

competition

for

attention

interest

based

navigation

Parrot TalkRequires Multiple Context Dimensions

co-habited mixed reality

COMRIS Soft Poster Presentation

slide20

LINGUISTIC CONTEXT

Numeric focus on

concept/instance: occurred

5: in previous message

3: 1 message ago

1: 2 or more messages ago

e.g. look-up (P_ID 25,

concept person, instance 26)

=> lcv(5,5)

John will give a presentation

on ubiquitous computing. He is

currently in your neighborhood.

ContextModel

PROFILE CONTEXT

user’s interest in:

topic/ person:

1: might be interested in/might want to meet

3: are interested in/want to meet

5: your favourite topic/absolutely wanted to meet

When generating natural language,

especially for output on a wearable device, more than one dimension of context needs to be taken into account. Our context model allows for annotating the propositional contents of a message with different types of context information in a uniform way.

e.g. -person..-p_pv:-pnumval 5

:-pqval “for socializing”

Joe Scott, whom you absolutely wanted

to meet for socializing, will be giving a talk.

EXTRA-LINGUISTIC CONTEXT

time

0: today

+1: tomorrow

+.10: in 10 minutes

space:

close-by, at the other

side of the building,

on the same floor

social implicature:

user is

1: standing, wandering around

3: moving towards a goal

5: talking to someone

e.g.-pract:-date (:-day 31:-month 1:-d_elcv 0)

:-timing (:-hour 10 :-minute 0)

:-place (:-l_name “the coffee room”

:-l_ID 9910 :- l_elcv “around the corner”)

Joe Scott proposes to meet you today at 10 o’clock in the coffee room around the corner

COMRIS Soft Poster Presentation

slide21

natural

language

generation

module

[#Bob F. #FERNANDEZ GOMEZ / ] , whom you [very much ] wanted to V-meet / , V-p roposes to V-meet you / to V-discuss about *[ACL / ] and *[ontologies // ] *[tomorrow / ] at [*10 o'clock / ] in *[the coffee room / ], [around the corner ] .///

discourse

module

Speech annotated output

context sensitive NLG process model

the information layer

PRAs play

a scene & compete for

the attention

of the user

profile

context

propositional

content

(defparameter *mprop1*

"[(COOP meeting-proposal)

(PERSON [

(FIRSTNAME \"Bob F.\")

(LASTNAME \"FERNANDEZ GOMEZ\")

(SEX m) (ID \"delegate-023\") ])

(EVENT [

(EVTYPE \"appointment\")

(KEYWORD_LIST [(FIRST [(T_NAME \"ACL\")

(T_ID \"topic-acl\")])

(REST [(FIRST [(T_NAME \"ontologies\")

(T_ID \"topic-ontologies\")])

(REST [])])]) ]) ])

(TAKESPLACE [(ID \"L10\") (NAME \"the coffee room\")])

(START [(DAY 28) (MONTH 12)

(TIME [(HOUR 10) (MINUTE 00)])])

(CONTEXT [(PERSON_PV [(PNUMVAL 4) (P_QVAL \"for socializing\")])

(PERSON_LCV [(CONCEPT 3) (ENTITY 1)])

(TOPIC_PV [(FIRST 3) (REST [(FIRST 3) (REST [])])])

(TOPIC_LCV [(FIRST [(CONCEPT 5) (ENTITY 5)])

(REST [(FIRST [(CONCEPT 5) (ENTITY 5)])

(REST [])])])

(DATE_ELCV 1)

(LOC_ELCV \"around the corner\")]) ]")

  • <Akel_content>
  • <Activity>
    • <status idref=“status-confirmation”/>
    • <involves>
    • <Person id=“delegate-023”>
    • <Person>
    • </involves>
    • <attending>
    • <Appointment>
    • <keyword idref=“topic-acl”>
    • <keyword idref=“topic-ontologies”>
    • <takesplace idref=“loc-010”>
    • </Appointment>
    • </attending>
    • <starts>2000-12-28 10:00:00</starts>
  • </Activity>
  • </Akel_content>

HTML annotated output

<A HREF=\\\"http://kiew.cs.uni-dortmund.de:8888/?expr=@'delegate-023'\\\" target=\\\"main\\\">Bob F. FERNANDEZ GOMEZ</A>, whom you very much wanted to meet, proposes to meet you to discuss about <A HREF=\\\"http://kiew.cs.uni-dortmund.de

:8888/?expr=@'topic-acl'\\\” target=\\\"main\\\">ACL</A> and <A HREF=\\\"http://

kiew.cs.uni-dortmund.de:8888/?expr=@'topic-ontologies'\\\" target=\\\"main\\\">ontologies</A> tomorrow at 10 o'clock in <A HREF=\\\"http://kiew.cs.uni-dortmund.

de:8888/?expr=@'L10'\\\" target=\\\"main\\\">the coffee room</A>, around the corner.

Each

component

contributes to the NLG

(natural language generation)

process model: the PRA provides the

propositional content and some profile

context, the PA provides the extra-linguistic

context, the NLG wrapper provides the linguistic

context information. The NLG module produces 2

annotated versions of the same base text, for speech

output (on the parrot) and for screen based interaction,

allowing the user to browse the information layer.

linguistic

context

extra-linguistic

context

COMRIS Soft Poster Presentation

the comris vision4
The COMRIS Vision
  • Co-Habited Mixed Reality
  • The social engine and scaling
  • From parrot to component-wear
  • Context awareness at large
  • Self-Evaluation of a wearable assistant
  • CAVE interaction
  • COMRIS and social science

COMRIS Soft Poster Presentation

parrot self evaluation
Parrot Self-Evaluation

The parrot's advice creates an expectation for

future behavior.

Expectation monitoring can be

a basis for self-evaluation.

When is a user ready to shift attention?

COMRIS Soft Poster Presentation

the comris vision5
The COMRIS Vision
  • Co-Habited Mixed Reality
  • The social engine and scaling
  • From parrot to component-wear
  • Context awareness at large
  • Self-Evaluation of a wearable assistant
  • CAVE interaction
  • COMRIS and social science

COMRIS Soft Poster Presentation

slide26

parrot

Stereo camera

virtually

present

present

ComrisCave

Immersive Virtuality

COMRIS Soft Poster Presentation

slide27

A virtual meeting

in the cave

1) Represent participants

by stereo videos

2) Interest distances are

converted in a virtual

scenario

3) Enter the cave

4) Select a face by pointing

COMRIS Soft Poster Presentation

5) Increase/decrease interest

the comris vision6
The COMRIS Vision
  • Co-Habited Mixed Reality
  • The social engine and scaling
  • From parrot to component-wear
  • Context awareness at large
  • Self-Evaluation of a wearable assistant
  • CAVE interaction
  • COMRIS and social science

COMRIS Soft Poster Presentation

can comris provide insights for social science
Can COMRIS provide insights for social science?
  • COMRIS has a strong hypothesis about what makes a complex society function.
  • COMRIS introduces technology as ‘grease’ in crucial aspects of that functioning

What can be legitimatly concluded from such an experiment

COMRIS Soft Poster Presentation

comris society model

Competence

Relevance

Context

Appearance

Presentation

COMRIS Society Model

Society

Community

Agent

interest

Resources

Environment

COMRIS Soft Poster Presentation

comris to come
COMRIS: to come
  • Toward the COMRIS co-habited mixed reality demonstration
  • Usability testing
  • Parrot component design goes on
  • Dissemination
  • Exploitation

COMRIS Soft Poster Presentation