1 / 7

Workshops on Evaluations of Human Level Intelligence

Workshops on Evaluations of Human Level Intelligence. Joscha Bach Nick Cassimatis Ken Forbus Ben Goertzel Stacey Marsella John Laird Pat Langley Christian Lebiere Paul Rosenbloom Matthias Scheutz Satinder Singh Bob Wray Paul Bello Bob Marinier . Our Goal.

yaron
Download Presentation

Workshops on Evaluations of Human Level Intelligence

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Workshops on Evaluations of Human Level Intelligence Joscha Bach Nick Cassimatis Ken Forbus Ben Goertzel Stacey Marsella John Laird Pat Langley Christian Lebiere Paul Rosenbloom Matthias Scheutz Satinder Singh Bob Wray Paul Bello Bob Marinier

  2. Our Goal • Encourage cumulative research in AGI • Encourage more formal evaluation and comparison • Get people working on similar problems • Common testbeds, … • Will naturally lead to more collaboration, more cumulative research

  3. Curse of Generality • How can we test claims across broad ranges of domains and tasks? • Usually interested in broad competence not optimality? • AGI must also have generality within a task • Play chess, explain own play, discuss strategy and tactics, teach chess, provide commentary, develop variations

  4. Curse of Complex Systems • Which component is responsible for behavior? • Fixed architecture • Individual components? • Structure of connectivity • Shared representations? • Initial knowledge • Is behavior result of clever knowledge engineering? • Learned knowledge • Difficult to control • Leads to lesion studies

  5. Uses of Task Environments • Pursue specific questions • Often custom environment to stress one aspect of intelligence • Or more complex environment to explore combinations of environments • Compare to other research • Prior research in my group • Other related research in the field • Usually simple specialized environment • Evaluate generality • Implement on a wide variety of tasks - existing tasks that are available • Not developed by us – some ecological validity • Explore new (possibly large and complex) environment • Forced integration of many capabilities • We know it will stress system in new ways: might discover missing pieces • Does not lend itself to careful experimentation and credit assignment

  6. Alternative Research MethodologiesLead to Alternative Tasks • Knowledge-rich – many tasks, complex environment • Large and complex skill knowledge • Large and complex conceptual knowledge [-embodied] • Knowledge-lean – many tasks, complex environment • Structured training • Unstructured training • Single task which requires many different cognitive capabilities 1, 3, 4, and maybe 5 can probably share a similar environment

  7. Next Steps • Develop concrete proposals how each approach and associated testbeds and tasks. • Pursue funding to get testbeds developed. • Open Source

More Related