280 likes | 432 Views
The GLAIR Cognitive Architecture. Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science State University of New York at Buffalo shapiro@buffalo.edu jpbona@buffalo.edu. Outline. Overview Integration of Acting and Reasoning
E N D
The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science State University of New York at Buffalo shapiro@buffalo.edu jpbona@buffalo.edu
Outline • Overview Integration of Acting and Reasoning Symbol Grounding Shapiro & Bona
Grounded Layered Architecture with Integrated Reasoning • Major Concern: • Knowledge Representation and Reasoning • Driving Motivation: • Natural Language Understanding & Generation • Additional Concern: • Agents that act • Question: • Where do beliefs come from? • Partial Answer: • Agent’s being embodied • Agent’s being situated in the world Shapiro & Bona
GLAIR Architecture Mind KL Independent of lower-body implementation Body PMLa PMLb Dependent on lower-body implementation I/P s o c k e t s PMLc Proprioception Speech W O R L D Hearing SAL Vision Motion Shapiro & Bona
Sensori-Actuator Layer • Sensor and effector controllers Shapiro & Bona
Perceptuo-Motor Layer • PMLa • PMLb • PMLc Shapiro & Bona
PMLc • Abstracts sensors & effectors • Body’s behavioral repertoire Shapiro & Bona
PMLb • Translation & Communication • Between PMLa & PMLc • Highest layer that knows body implementation Shapiro & Bona
PMLa • Grounds KL symbols • Perceptual structures • Implementation of primitive actions • Registers for Embodiment & Situatedness • Deictic Registers • Modality Registers Shapiro & Bona
The Knowledge Layer • Implemented in SNePS • Agent’s Beliefs • Representations of conceived of entities • Semantic Memory • Episodic Memory • Quantified & conditional beliefs • Plans for non-primitive acts • Plans to achieve goals • Beliefs re. preconditions & effects of acts • Policies: Conditions for performing acts • Self-knowledge • Meta-knowledge Shapiro & Bona
Outline Overview • Integration of Acting and Reasoning Symbol Grounding Shapiro & Bona
SNePS • A KRR system • Every non-atomic expression is simultaneously • An expression of SNePS logic • An assertional frame • A propositional graph • Every SNePS expression is a term • Denoting a mental entity Shapiro & Bona
Ontology of Mental Entities • Entity • Proposition Agent can believe it or its negation Includes quantified & conditional beliefs • Act Agent can perform it • Policy Condition-act rule agent can adopt • Thing Other entities: individuals, categories, properties, etc. Shapiro & Bona
PoliciesReasoning Acting • Forward Reasoning whendo(φ, α) wheneverdo(φ, α) • Backward Reasoning ifdo(φ, α) Shapiro & Bona
Types of Acts I • External Acts affect the environment supplied by agent designer • Mental Acts affect the knowledge layer believe, disbelieve adopt, unadopt • Control Acts sequence, selection, loop, etc. Shapiro & Bona
Types of Acts II • Primitive Acts Implemented in PMLa • Composite Acts Structured by control acts • Defined Acts Defined by ActPlan(α, p) belief Shapiro & Bona
Acting ReasoningControl Acts snif({if(φ1, α1), …, if(φn, αn), [else(δ)]}) sniterate({if(φ1, α1), …, if(φn, αn), [else(δ)]}) withsome(x, φ(x), α(x), [δ]) withall(x, φ(x), α(x), [δ]) Shapiro & Bona
Goal Talk GoalPlan(φ, p) achieve(φ) Shapiro & Bona
Behavior Cycle English (Statement, Question, Command) (Current) Set of Beliefs Reasoning Clarification Dialogue Looking in World NL Analysis (Updated) Set of Beliefs (New Belief) Answer Actions Reasoning NL Generation English sentence expressing new belief answering question reporting actions Shapiro & Bona
Outline Overview Integration of Acting and Reasoning • Symbol Grounding Shapiro & Bona
Entities, Terms, Symbols, Objects • Agent’s mental entity: a person named Stu • SNePS term: B4 • Object in world: BICA 2009 Shapiro & Bona
Alignment Mind (KL) KL term PML structure Body (PML/SAL) World Object/Phenomenon Action Shapiro & Bona
Deictic Registers For being situated in the world PML registers hold KL terms Iterm denoting agent YOUterm denoting dialogue partner NOWterm denoting current time Shapiro & Bona
Modality Registers For privileged first-person knowledge of what agent is doing Register for each modality holds KL term denoting act modality is engaged in Shapiro & Bona
Building Episodic Memory ! KL ! ! after before time event event time e1 t1 e2 t2 agent act act agent time ! b1 q a1 a2 duration I COUNT n NOW 0 PML hom ACT Shapiro & Bona
For More DetailsSee the Paper Shapiro & Bona
Collaborators Past and present members of SNeRG: The SNePS Research Group http://www.cse.buffalo.edu/sneps/ Shapiro & Bona