1 / 14

PyClarion / Mockingbird

PyClarion / Mockingbird. Michael F. Lynch. What is Clarion?. A hybrid cognitive architecture developed at the Department of Cognitive Science at RPI by Ron Sun and colleagues. Four major subsystems, each supporting an upper, symbolic layer and lower, sub-symbolic layer.

wanda
Download Presentation

PyClarion / Mockingbird

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PyClarion / Mockingbird Michael F. Lynch

  2. What is Clarion? • A hybrid cognitive architecture developed at the Department of Cognitive Science at RPI by Ron Sun and colleagues. • Four major subsystems, each supporting an upper, symbolic layer and lower, sub-symbolic layer. • Models, among other things, motivation (drives and goals) and metacognition • Also models (in Wilson’s version) personality.

  3. Clarion Action NACS Action-CenteredExplicit Representation Non-Action-CenteredExplicit Representation ACS Action-CenteredImplicit Representation Non-Action-CenteredImplicit Representation Perception Reinforcement Goal Structure Goal Setting Drives Filtering/Selection/Regulation MS MCS

  4. What is PyClarion? • Another rewrite, necessitated by limitations in the C# edition, this time in Python. • Uses the PyBrain library by Schmidhuberet al for its neural net implementations. • This is turn will form the basis for further work into episodic memory. • Also the basis for Mockingbird, an interactive musical agent (IMA).

  5. Mockingbird

  6. What is Mockingbird? • … an attempt to build an Intelligent musical agent (IMA) based on Ron Sun’s Clarion cognitive architecture and Doug Van Nort’s FILTER expanded musical instrument (aka “hyperinstrument”).

  7. Mockingbird – What it Does • Mockingbird interacts with a live performer in a free improvisation performance. • Mockingbird analyzes, via FILTER, the human performer’s auditory live audio signal, and makes decisions in real time to create its own musical accompaniments.

  8. Positioning Mockingbird • “Tape delay” (and later digital delay) music has a long tradition, dating back to the 1950s. • Builds on the musiqueconcrètetradition of Pierre Schaeffer. • Among the early pioneers: Pauline Oliveros, right here at RPI.

  9. Expanded Instruments • Oliveros’s EIS • Van Nort’s GREIS (inspired by EIS) • Van Nort’s FILTER • CAIRA (Creative, Artificially-Intuitive and Reasoning Agent) • Mockingbird

  10. Mockingbird – Design Goals • Construct a musical “agent” (a musical accompanist and improviser) • Our term: Intelligent Musical Agent (IMA) • Identify and develop cognitive models of musical performance needed in such an agent. • Implement these models in an actual agent, using the Clarion cognitive architecture as the “substrate.”

  11. Mockingbird – Initial Goals • Be able to listen to a single live performer • “Learn” the contours of the performance during the actual performance • From that, accompany the performer in the manner of free improvisation, one-on-one, playing back the performer’s own materials, time-delayed and transformed. • That’s why it’s called Mockingbird.

  12. What is Needed…

  13. Python programmers… especially if you are really good with multiprocessing programming techniques. • People interested in neural nets and working with the PyBrain library. • People interested in cognitive architectures and working on Clarion. • People interested in these sorts of issues in experimental music.

  14. lynchm2@rpi.edu

More Related