RAIR Lab Slides on NIMD R&D SanFran Review @ P9 (draft v5 of 020605 for 021304)

1. RAIR Lab Slides on NIMD R&DSanFran Review @ P9(draft v5 of 020605 for021304) draft of 020604 Selmer Bringsjord Andrew Shilliday • Joshua Taylor Jason Wodicka • Marc Destefano RAIR Lab (SB, Director) Department of Cognitive Science (SB, Chair) Department of Computer Science RPI Troy NY 12180 USA

2. @ RPI

5. The Rensselaer AI & Reasoning Lab(The RAIR Lab) Wargaming  Cracking Project; Intelligent Tutoring Systems (mathematical logic) Long ago, RPI Strategic Investment Slate (Intelligence Analysis) Item generation (theorem proving-based generation) synthetic characters/psychological time

6. RAIR Lab’s IA/Wargaming NIMD/Sage Web Site . . . . . . . . . . . .

7. vTour (brief!)

8. The View from the Start of Project: v1, ... Visionary Real Widely Used Real (revelation/revolution) ...

9. The View from Now: Real Widely Used Real (revelation/revolution) ...

10. Slate is... • an intelligent assistant to IAs; • part of virtual IA’s mind in the “Black Box” (reasoning component of system that includes ACT-R) Simulated Human User; • a system for scoring performance of subject in Sage (and related environments); • a system for teaching IA reasoning; and of course... • a plug/unplug part of Sage. • And all along the way: • publications and presentations (many; see our ever-growing list with other members of the Sage team); • empirical investigation of the nature of IA reasoning.

11. Invaluable Feedback from Analysts v1.1 Demo #1 v1.4

12. { platform independence patented?; head toward product justifications in English ... The View from Now: Real Widely Used Real (revelation/revolution) ...

13. Micro-Scenarios and Slate • Why? • The right size for rigorous experimentation in psychology of reasoning. • H1: Use of Slate will increase as the difficulty of the scenario/case study increases. • H2: The standard training of analysts is more efficacious when extensive training in formal logic (three or more courses) is added. Best is to train analysts using Sage and Slate! • H2: Non-analysts with three or more courses in formal logic compete favorably compared to trained analysts with years of experience when both groups’ performance is measured in connection with well-defined scenarios. • Slate as a system for teaching IA, reasoning, logic, etc. (when we teach reasoning, we use small problems). • Some info to populate the REASONING component of the Simulated Human User (SHU). • Ideal venue for concretizing collaboration withCYCORP.

14. Subject TacklingMicro-Scenario “New Order #1”

15. Subject TacklingMicro-Scenario “New Order #1” Video of Subject Tackling Micro-Scenario #1

16. Subject TacklingMicro-Scenario “New Order #1” Demo #2: “Well-Logger #1”

17. Selmer on 9/4/03:Re. Glass Box • Collecting low-level behavior of John Updike won’t tell you how he pulls it off. • VPA on Updike would probably generate fiction-on-the-fly. • Why not move Sage-like/Slate-like approach into the Glass Box itself? • Configure a stimulus as tight, micro-case study; make predictions; run subjects; collect and analyze data. Ah! Better: Instead...

18. “Boost” the Glass Box! Glass Box Data • Investigate hypotheses about higher-lever cognition formulated on the basis of GB data. • Sage/Slate can be used to present controllable correlates for things that happen in the GB. Hypotheses Corresponding Scenario Sage & Slate: Fully Conrollable, Programmable Testing Environment Hypotheses Confirmed/Disconfirmed